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CHAPTER I 


THE BEGINNING 

1.1 Techniques of System Control 

The underlying notion of modem control system theory is the 
acceptable control of a process that has the inherent capability of 
being influenced. The process is mathematically described in a way 
so as to potentially define its behavior completely for any choice 
of control stimulus; the collection of all variables for defining 
the process behavior is called the state. The primary objective of 
control System theory is to define the evolution of a control stimulus 
in order to cause the evolution of the process state to behave in a 
desired manner. 

In some cases* the control may not be dependent upon the system 
state. However, for most instances the control does depend upon the 
system state and consequently at least some of the variables in the 
state evolution must be measured in order to construct the evolution 
of the control: such a situation is called feedback control. 

For a significant percentage of applications, it is either 
impossible or undesirable - perhaps from a cost standpoint - to measure 
all the state variables called for in the control law. In this instance, 
the choice is either to alter the criteria defining the acceptability 
of the state behavior so as to eliminate the nece.ssity of measuring 
the unavailable state variables, or to find a simple way to make the 
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un available measurements that are needed. Moreover, with the presently 
known criteria of system control, the conditions for which the desired 
behavior of the system state can be made to depend only upon available 
measurements are not always clearly understood. 

1.2 Purpose of Work Herein Reported 

This dissertation adopts the second choice noted above, namely 
the simple generation of state from the available measurement^, for 
use in systems for which the criteria defining the acceptable state 
behavior mandates a control that is dependent upon unavailable measure- 

d <•?-.. * 

ment. (It is assumed that the system structure allows such a generation 
of state, ) 

To be sure, this approach has been actively investigated pre- 
viously [l]-[4] for systems in which the parameters are known. This 
dissertation proposesvjan^ adaptive means for determining the state 
of a linear time -in variant differential system having unknown parameters 
by using only available measurements. This procedure is called an 
adaptive observer. 

The adaptive observer not only generates the state of a linear 
time -in variant dynamical system having unknown parameters but also 
simultaneously identifies all or some - dependent upon the observer 
structure - of the system parameters . 

The adaptive observer possesses some noise suppression qualities, 
dependent upon a free choice of observer eigenvalues. In the absence 
of noise the adaptive algorithm employed is guaranteed to converge to the 
proper values regardless of the magnitude of parameter ignorance 
or of the magnitude of the adaptive gain constants selected, and 
requires no derivatives of output or of other measurements 
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for implementation. There is inherent freedom in adjusting the 
adaptive rate of convergence. Some restriction, however, is placed 
upon the system input to insure parameter identification. 

The adaptive observer appears in either a full-order version 
(that is, of same dynamic order as the system being observed, discount- 
ing the adaptive algorithm) for single-output systems or a reduced order 
observer for multiple output systems. The full-order adaptive observer 
completely identifies the system parameters and generates as well the 
entire state of the single-output system. The reduced-order observer 
generates the remainder of system state information needed to completely 
construct, along with the output information, the state of the system, 
and partially identifies the parameters of the system. 

1.3 Organization of the Dissertation 

The major contribution of this dissertation appears in Chapters 
IV and VI. Chapter IV has appeared substantially in [71] and Chapter 
VI in [72], In these two chapters, the single-input single-output 
adaptive observer and the reduced adaptive observer is developed. 

Chapter V surveys the investigations into the adaptive observer by 
other authors undertaken subsequent to the initial report by this 
author of the material in Chapter IV. Chapter II examines the basic 
ideas for the non-adaptive (Luenberger) observer for linear time- 
invariant dynamical systems with known parameters, and in doing so 
lays a foundation for the construction of Chapters IV and VI. Chapter 
III is a survey of the Lyapunov synthesis technique. Lyapunov synthesis 
is employed in the adaptive algorithm for the adaptive observer. This 
survey has appeared as [69] and contains 40 references. Chapter VII 
outlines a considerable amount of work left for future research. 



CHAPTER II 


THE NON- ADAPTIVE OBSERVER 

2.1 The Worth of The Observer 

Unlike the Kalman filter [ l], the Luenberger observer [2,3,4] for 
generating the state of a system using input and output measurements 
is theoretically postulated in a noise-free environment. The worth 
of the observer, however, rests ultimately upon the likelihood that 
noise is inherent in the available measurements. 

To understand the motivation for the observer, consider the three 
following means of generating the state of the system. 



when given the input r, the output y, the structure of the system 
matrix, input matrix, and output matrix, and the values of the 
parameters in each of these matrices. Although these three methods 
are discussed here with respect to (II. 1) for illustration, the comments 
apply to a general linear system. 

One possibility is to determine x 2 and x g by differentiators, 
illustrated in Figure 2.1(a). This method simply recognizes that 
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x 3 = *2 = *1 = y 

from (II.l). Thus one may ascertain by differentiating y 
and by differentiating y twice. In the absence of measurement 
noise introduced at any point within or without the system, and by 
assuming the availability of a perfect differentiation algorithm, 
this differentiation technique is successful. However, in the 
presence of broad band or high-frequency noise (even assuming the 
feasibility of a perfect differentiator) , the magnitude Bode-plot 
characteristic of a differentiator prohibits a meaningful result to 
emerge. Since noise within a system, or in the differentiation 
itself, is very common, the differentiation technique has little 
value . 

The parallel-model scheme, illustrated in Figure 2.1(b), is 
based upon the certain knowledge of the system parameters and 
structure. A model is constructed identical to the system, but so as 
to allow access to the model state (unlike the corresponding system, 
in which only the output is accessible). The system state is identical 
to the model state when both the system and the model are in a noise- 
less environment, when the same input is applied to each, and when 
the initial conditions are the same in each. The initial condition 
requirement may be waived if the system is stable, since then the 
effect of the initial condition eventually vanishes. 

The state of the model is therefore used in place of the system state 
to implement a control law. This arrangement is an open loop process in 




Generation of St$.te By Parallel- Model Scheme 
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that the output of the system is not connected to the input. 

The lack of feedback in the system control law does not allow the 
decreased sensitivity to disturbances - occurring at the system input, 
within the system, or in the output measurements - that is a beneficial 
property of feedback control. Rather, noise originating within the 
system or (if possible) within the model seriously affects the behavior 
of the system, especially since the system may well receive disturbances 
unequal to that received by the model. Consequently, while the parallel- 
model scheme is more valid than the differentiation scheme, it has limited 
usefulness in a noisy environment. 

The third scheme is the model- following scheme of Figure 2.1,c). 

The observer is characterized by this scheme. 

When the model estimate of the system state is used to control the 
system, the result is feedback control. Moreover, it will be later seen 
that the model- following scheme allows an inherent capability of noise 
suppression not present in the other two schemes, an additional advantage. 

From the preceeding it may be readily perceived that, although 
the observer is postulated theoretically to be implemented in a distur- 
bance-free environment, its worth rests in the inherent ability of the 
observer both to be less sensitive to the origination of measurement 
noise and to possess the capability to suppress the adverse effects of 
noise. 

However, the observer is not necessarily optimal with regard to 
noise suppression as is the Kalman filter. Consequently, the usefulness 
of the observer is mainly limited to those cases for which the signal- 




Figure 2.1 (c) 

Generation of State By Model Following Process 
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to-noise ratio is high enough so that it is not considered worthwhile 
to implement the optimal Kalman filter. Since the various forms of 
the observer allow considerable reduction in complexity, when compared 
with the Kalman filter, the use of the observer rather than the Kalman 
filter, when noise considerations allow, presents an attractive alter- 
native . 


2.2 The Full-Order Observer 

The basic notion of the model- following scheme illustrated in 
Figure 2.1(c) is that the model, which is fed by the output of the system 
whose state is to be observed, tends to track a linear transformation 
of the system state if the model is stable. It is this basic tendency 
which allowed Luenberger [2] to formulate the particular dynamics of 
the model so that it eventually perfectly tracks a transformation of 
the system state. When the model is designed so, it is called an 
observer. 

The full-order observer is of the same dynamic order as that of 
the system. The Luenberger observer [2 ,3, 4], which is discussed in 
this section, is defined for a linear time-invariant differential 
system in the absence of a disturbance vector. This system may be 
described by the equations 


x = Ax + Br 


(II. 2) 


y = Cx 

in which x e £ n is the system state , r e £ m is the system command input 
vector, y e £ p is the system output, and A, B, and C are appropriately- 
dimensioned matrices which are known and constant with time. It is 
assumed that the pair (C,A) is completely observable. Moreover, it is 
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assumed without restriction that C is of rank p. 

The observer is hypothesized as 

z = Fz + Gy t Dr (II. 3) 

for which z e ^ n is the estimate of the system state x. By constructing 
the observer (II. 3) so that the observer state z is available for 
measurement and by defining F, G, and D so that z -* x, then the state 
of the system x can be determined by measuring z rather than x. This 
is accomplished, it is noted, by utilizing only the available system 
measurements y and r in the observer (II. 3). 

Rather than make z -> x as just described, the system (II. 2) can 
first be transformed by the non-singular square matrix T by defining 
x = T x; then (II. 2) becomes 

x = T _1 ATx + T -1 Br (II. 4) 

y = CTx 

Now the observer may be built so that z -*■ x or that z T ^x.* 
Consequently a transformation of the state of the system (II. 2) may 
be observed. This additional freedom possibly allows greater flexibility 
in actually constructing the observer. 

An error vector e c n may be defined as 

eHz-x=z-T^x (II. 5) 

in which e is a comparison between the observer state and the system 
state. The desired condition that z *► x or, equivalently, z -*■ T ^x is 
the same as requiring e -*■ 0. 

To find conditions on G, F, and D in (II. 3) so that e -> 0, a 
differential equation in the dependent variable e is derived and 
conditions are imposed so that the equilibrium e = 0 is asymptotically 
* This unusual notation is employed in anticipation o r later chapters. 
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stable. 

Differentiating (II. 5) gives 
* 

• « 

e = z - x 

= Fz + Gy + Dr - T ^ATx - T _1 Br 
which may be rewritten as 

e = Fe + (F-T -1 AT + GCT)x + (D - T _1 B)r (II. 6) 

In (II.6), suppose that F is an asymptotically stable matrix 
[5]; then e is bounded whenever the inputs (F - T ^AT + GCT)x and 
(D - T _1 B)r are bounded. To make e -*■ 0 it is sufficient to make 
F - T ^AT + GCT = D - T = 0. Doing this, F, G, and D are defined 

so that 

FT -1 = T -1 A - GC (II. 7) 

D = T _1 B 
Then (II. 6) becomes 

e = (T^AT - GCT)e (II. 8) 

and the equilibrium of e is asymptotically stable if the eigenvalues 
of T ''‘AT - GCT all have negative real parts. This implies that the 
initial condition of e vanishes at a rate dependent upon the values 
of the eigenvalues of T ^AT - GCT. Thus e -* 0 asymptotically. 

The question remains, is it possible to make F = T AT-GCT have 
eigenvalues all with negative real parts for any matrices A and C? 

Luenberger showed [2] for a single-output system, and Wonham 
showed [6] for a multi-output system, that the answer is affirmative 
whenever the pair (C,A) is completely observable. 

In addition, Luenberger showed that if the eigenvalues of F and 
A are not identical, then the non-singular matrix T exists satisfying 
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(II. 7). This result is somewhat intuitive, since G = 0 in (II. 7) is 
equivalent to saying that F and A have the same eigenvalues, and implies 
that the output information is omitted from the observer (II. 3). 

Thus with F = T -1 AT - GCT, the solution to (II. 8) is 

e(t) = exp[F(t-t Q ) ]e(tg) (II. 9) 

in, which the behavior of e is explicitly obtained. The more negative 
the real parts of the eigenvalues of F are, the more rapidly the error 
between the system state and the observer estimate of that state 
vanishes. 

However, eigenvalues of F with highly negative real parts 

tend to make the observer behave like a set of differentiators. For 
effective noise suppression F should be chosen with time constants 
roughly equal to the time constants of the system (II. 2) C4]. It is 
seen that a tradeoff exists between rapid estimation of system state and 
effective noise suppression in the estimate. 

At present, criteria for the optimal location for placing the 

eigenvalues of F for the various kinds of Luenberger observers has 

not been reported , although the Kalman filter does so for the full order 
observer. 

If the transformation matrix T is chosen as the identity matrix, 
then the resulting observer configuration is known as the identity 
observer. For T = I, the equations (II. 7) are 



Then the observer estimate z approaches x. 
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2.3 The Reduced-Order Observer 

In (II. 2) it is seen that the output y represents information 
about the state x directly without necessity of generating that 
information. This can be illustrated explicitly by introducing the 
t r ans format ion . 

C 

x = [ * * * ]x ( II • 11) 

M 

in which M is any matrix selected so that the transformation is non- 
singular. Then in the transformed system, analogous to (II. 4), the 
output equation is 

y = [I * 0] x (11.12) 

P • 

where I is an identity matrix of rank p. 

Using the transformation (II. 11) it is seen that there is no 
necessity of generating the first p state variables of x by an observer 
since they are directly measurable in the output y according to (11.12). 
The question naturally arises, is there an observer structure which 
generates only the lower n-p state variables of the state x, and if 
so, is there an advantage in employing it rather than the full order 
observer? 

The answer to both questions is affirmative. The advantage of 
the observer structure which generates only the missing state variables 
iii (11.12) is that its dynamic order is n-p rather than the full-order 
n dimension. 

The reduced-order observer is due to Luenberger [3], but the 
development given below follows Gopinath [7]. 

It is assumed that transformation (II. 11) has been made (if 
necessary) of system (II. 2) so that the output equation is as (11.12). 
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Then (I I. 2) is written as 
x = Ax + Br 



(11.13) 


in which it is understood that A and B have been transformed by (II. 11) 
and the notation x has been dropped in favor of x for simplicity. 

Now (11.13) is partitioned. The first p state variables of x 
equals y, and the remaining are denoted as w so that 



Then accordingly (11.13) is written as 
y = A xl y ;+ A 12 w + BjT 


(11.14) 


w = A 2i y + A 22 w + B 2 r 

for which y is measurable and w e 6 n ^ is not. 

The reduced observer is hypothesized as 

z = Fz + Ly + Dr (11.15) 

in which z e & n_ ^ is an estimate of a function of w as illustrated 
in Figure 2.2. 

An error vector is defined as 


e = z t Gy - w 

The object is to make e -+ 0 ; then z + Gy = w. To insure e -»• 0, the 
matrices L, F and D are to be chosen so that the error equation is 
asymptotically stable about its equilibrium e = 0. The underlying 
motivation in accomplishing this is to construct an identity observer 
for the second equation in (11.14) using y and r as multiple inputs. 
From above, 



System 
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e = z + Gy - w 

= [Fz + Ly + Dr] + Gy - [A 21 y + A^w + B 2 r] 

= Fe + (F - A 22 )w + (L - FG - A^y + Gy + (D-B 2 )r 


Suppose that L = FG + - GA.^. *^ le a ^ l0Ve becomes 

e = Fe + (F-A 22 )w + G (y - A^y) +(d - B 2 )r 
Since, from (11.14), 

y ~ A n y = A 12 W + B i r 

the error equation is equivalent to 

e = Fe + (F - A 22 + GA^w + (D + GB^ - B 2 )r (IV. 16) 

Equation (11.16) is analogous to (II. 6), which is the full-order error 
equation. As in the full-order equation, if F and D are defined as 
F = A 22 - GA 12 

(11.17) 


D = B 2 - GB 1 
then (11.16) becomes 

e = Fe (11.18) 

for which the discussion following (II. 8) applies here. 

The n-p eigenvalues of F may be arbitrarily chosen if and only if 
the pair (A 22 , A^) is completely observable [6]. It has been shown 
[7] that if (C,A) is completely observable, then so is (A 22 , A^ 2 ). 

(The simple proof is omitted here.) Consequently the eigenvalues of 
F may be arbitrarily chosen when observing the state of system (II. 2). 

The observer for the system is therefore 

z = (A 22 - GA 12 )z + (A 22 - GA l2 )Gy + (A^ - GA n )y 

+ (B 2 - GB 1 )r (II. 19) 


and the estimate of x is 
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for the state x e of system (11.13). 

i 

One Important point regarding this reduced-order observer will 
be made here. The particular form (11.19) of the reduced observer 
derived here is but one of many possible. That is to say, the system 
(11.13) may be transformed by a non-singular matrix T, analogous to 
(II. 4), to allow many different forms of the observer equation (11.15). 

2.4 Closed-Loop Properties of the Observer 

An important feature of the observer is the ability to not adversely 
affect the stability of a closed-loop system employing the observer 
within the loop. An example of this application, illustrated in 
Figure 2.3, is the pole placement problem. The state estimate generated 
by the observer is used in a linear time-invariant feedback to adjust 
the system poles. Since the observer estimate of the system state is 
used rather than the (unmeasurable) system state, it would be undesirable 
yet conceivable - that the system becomes unstable in the closed loop 
due to the presence of the observer. However, Luenberger showed [2] 
that the introduction to the observer within a closed- loop employing 
a linear time-invarient feedback does not affect the stability of the 
system. In fact, the poles of the composite system employing the 
observer are exactly the poles of the system >assuming the control law 
enjoyed state feedback, plus the poles of the observer. Since the 
observer poles may always be chosen stable, the overall stability of a 
closed-loop system is not affected when generating the state by means 


of an observer. 



Feedback Matrix 


Figure 2.3 

Reduced- Order Observer in Constant Feedback Loop 
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To see this, suppose the system 

x = Ax + Br (II. 2) 

y = Cx 

has . the control law 

r = Kx (11.20) 

Then supposing that the state is available for measurement (or that 

K = MC for some M), the closed- loop system is 

x = (A + BK) x (11.21) 

and its poles are the eigenvalues of the matrix A + BK. 

However, if an observer is employed to generate the state of 
(II. 2) for implementing (11.20), then using the equation (11.15) the 
control law becomes 

r = Kx = Ez + Hy (11.22) 

where z is the reduced-observer estimate and 

K = ET -1 + HC (11.23) 

Then the composite system is 


rn 

X 


" A + BHC 
-1 

BE 

-1 

z 


GC + T BHC 

F + T BE 



(11.24) 


Introducing the coordinate change C = z 
fxl C A + BK BEl 


T x, the above becomes 

"l 

(11.25) 


U J L 0 

The eigenvalues of (11.25), and therefore (11.24), are the eigenvalues 
of A + BK and of F. 

Consequently, an n order system that is completely controllable 
and completely observable with m independent output variables may, by 
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use of a linear feedback law and an observer of order n-p, have the 
2n-p eigenvalues of the closed- loop system take on any preassigned 
value . 

2 Other Kinds of Observers 

Other kinds of observers include observers which generate a linear 

function of system state variables, and observers which generate the 

state of time-varying systems, discrete systems, and stochastic systems. 

The linear- function observer generates a function e of the form 

T 

e = a x 
T 

where a is any desired row vector and x is the system state. The 
utility of such a function e is that many linear feedback laws merely 
require this function for control of pole placement within a time- 
invarient system. An observer which generates a linear function may 
be considerably lower in dynamical order than the multivariable 
observer of Section 2.3 which generates the state x. The linear- 
function observer was developed by Luenberger [3]. 

The major result of the linear- function observer is that the function 
a x can be generated by an observer of order v-1 where v is the 
observability index [3] of system (II. 2). The observability index v 
is defined as the least positive integer for which the matrix 

cc : ca : ca 2 : ... : ca v_1 3 t 
• • • « 

has rank n (equal to system order). For any completely observable 

system, (n/p)-l < U-l < n-p , and in many cases v-1 is much less than 

n-p. Therefore there is often a considerable savings in dynamic order 
'T 

by generating a x directly rather than generating x and then forming 
T 

a x. 
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The estimate of e = a x is 

A ,T T 
z = b y + c z 

z = Fz + Ly + T -1 Br 


where 


T -1 A - FT 


T T 
bC + c T 


-1 

-1 



and 


z e 


£ v-1 


(11.26) 


(11.27) 


The underlying notion for this capability is that the matrix noted by 
T - ^ need not be square if it is understood that its inverse does 
not exist. The design procedure is to choose T ^ so that the second 
equation in (IX. 27) is satisfied; then the remaining values of T 1 
and the values of L may now be determined by the first of these 
equations. Other techniques can also be used in the design. 

Observers for time-varying systems have been reported in [8] and 
[9]. Discrete time observers have been investigated in [10] - [12] and 
stochastic observers in [13] - [15]. 

Other papers of note are [16] - [21]. 



CHAPTER III 


THE LYAPUNOV SYNTHESIS TECHNIQUE 


3.1 Lyapunov Stability 

It is not the purpose of this thesis to delve deeply into the 
general stability problem or to survey the stability literature. However, 
within this section the basic concepts in stability which are used in 
the subsequent sections for synthesizing an adaptive algorithm are 
briefly described. 

The concept of Lyapunov stability deals with the family of motions 
defined by the differential equation 


x = f(x, t) t >_ t Q 


(III.1) 


in which it is assumed that the trivial solution x - 0 is a member of 
that family in the sense that 
0 = f(0 ,t) ,t >_ t Q 

Moreover, x = 0 is also called the equilibrium of { 111 . 1 ). Each member 
of the family of motions defined by (III.l) is designated by 
p (t , x Q , t^) , * 

where p(t Q , x Q , t Q ) = x Q . It is assumed that each p(t>vV is 
continuous in all its arguments whenever x Q is in the neighborhood of 
the equilibrium; in other words, p(t, x Q , t Q ) satisfies a Lipschitz 
condition [22]. 

The notion of Lyapunov stability is that the stability of an 
equilibrium of (III.l) can be determined by examining the behavior of 
the entire solution, for all t >_ t Q , with respect to the initial value 
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Xq. In particular, if the initial value is close to the equilibrium, 
then the subsequent motion p(t, x^ , t^) remains correspondingly close 
to the equilibrium. 

The precise definition [23] is that an equilibrium of the differ- 
ential equation (III.l) is called stable in the sense of Lyapunov if 
for every real number e > 0 there exists a real number 5 > 0 such that 

||p(t, x 0 , t 0 )|| foI ’ allt l t 0 

whenever | | j | <_ 6 • 

Consequently it is the relationship between the initial value x Q 
and the ultimate bound on the motion p(t, x^ , t^) that denotes stability 
in the sense of Lyapunov. Indeed, it is easy to visualize trajectories 
which are bounded for all t >_ t^ but not stable due to a lack in 
relationship between that bound and the closeness of x ( ^ from the 
equilibrium. It should be pointed out that the definition of stability 
applies only in the neighborhood of the equilibrium. 

An equilibrium of (III.l) is said to be attractive [5] if there 
exists a real number n > 0 for which 
lim p(t, Xq , t Q ) = 0 

*t-K» 

whenever | | | | ± assuming there is no other initial value x’ such 
that f(x* ,t) = 0 for t >_ t Q and | |x’ | | <_ n . 

From the preceeding discussion it is readily seen that the attract- 
iveness of the equilibrium bears no relation to the concept of stability 
in that a motion which is stable need not be attractive and vice versa. 

Attractiveness of the equilibrium is a concept which applies only 
in the neighborhood of the equilibrium defined by | |x Q | | _< n- 

If in addition, however, the motion p(t, x Q , t ) is attractive for 
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every n > 0 then the equilibrium is said to be globally attractive. 

The concept of stability and attractiveness may be combined to 
form the concept of asymptotic stability. The equilibrium of (III.l) 
is said to be asymptotically stable in the sense of Lyapunov if it is 
both attractive and stable in the sense of Lyapunov. 

Moreover, if the equilibrium of (III.l) is both stable and globally 
attractive then the equilibrium is said to be globally asymptotically 
stable. 

Given the preceeding definitions (which by no means are the totality 
of definitions currently in use in the theory of Lyapunov stability 
[see 23]) ,it is desired, for purposes of this thesis, to state certain 
methods for determining the stability of the equilibrium of a differential 
equation with the ultimate aim of constructing a control to influence 
the stability of the equation. For this purpose, the so-called Direct 
Method of Lyapunov will be briefly examined. 

3.2 Lyapunov' s Direct Method. 

The Direct Method is a means of determining stability and 
asymptotic stability (either global or nonglobal). Unfortunately, the 
ability to use this method usually depends upon the ingenuity of the 
user. 

A simple explanation [5] of the Direct Method can be had with 

reference to Figure 3.1. Consider a differential equation of the form 

x = f(x) (III. 2) 

which, for purposes of illustration here, is taken as a vector equation 

with x e 'E 2 . Consider also a quadratic function 

T 

V = x Px 

in which P is a symmetric matrix having its two eigenvalues positive; 
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such a matrix is a member of a class of matrices called positive 
definite [24], The ellipses in Figure 3.1 represent the locus of 
the equations 



for positive constants Q.. 

Suppose the solution p(t , x Q ) of (III. 2) spirals toward the origin 
as indicated in Figure 3.1. Such a motion represents an asymptotically 
stable equilibrium with respect to the initial value. It is seen that 
any motion which is always directed inward to the ellipses is an 
asymptotically stable motion. This property is taken as an easy 
test to determine whether the equilibrium of (111.2) is asymptotically 
stable. In order to gain a relationship in terms of V to insure that 
the motion spirals inward with respect to the ellipses, the angle between 
the trajectory (in the direction of motion) and the ellipse is required 
always to be negative. 

Taking the outer normal to an ellipse as 


grad V = 


3V/9x 2 


it is desired to compute the angle \ p between a trajectory and the outer 
normal. Then 

(grad V) T x 

cos ip = =- 

| I ( grad V) x| | 

The trajectory is always inward with respect to the function V whenever 
cos ip < 0. Since the denominator of cos ip is always positive, the 
condition is that 


(grad V)^x < 


since in this case 
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, a J. 3V . 5V . d 
(grad V) x = ^x 1 . -j^x, - ^ V 

the requirement that V be negative along the trajectory insures that 
the solutions of (III. 2) are asymptotically stable. 

This simple viewpoint can be expanded into a rigorous test for 
stability known as the Direct Method. 

One theorem for stability is the following [5]: let V(x) be a 

function with continuous first order partial derivatives. Suppose 

♦ 

there exists a region G such that 0 < V(x) < a in which V <_0. Let 
M be the largest invariant subset of the set V = 0. Then every motion 
of (III. 2) which begins in G tends toward M. 

As a corollary to the above theorem, the more familiar theorem is 
given ; 

If additionally V(x) is positive definite with derivative V for 

(111. 2) negative semi-definite (definite) or identically zero, then 
the equilibrium of (III. 2) is (asymptotically) stable. If in addition 
there exists a monotone increasing function w ( ) | x| | ) such that 

V( x) >_ w ( | | x| | ) and if w ( | | x| | ) + » as | j xj | ■+ «■ , then the equilibrium of 

(111. 2) is globally (asymptotically) stable. 

In analyzing an equation of the form (III.l) or (III.2)to 
determine the stability of an associated equilibrium, a function V 
is sought which satisfies the condition of the theorems here given 
(or the numerous other theorems omitted here). Failure for the V 
function to be as described does not imply instability of the 
equilibrium however, only that the choice of V was inappropriate. Although 
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there exist several methods of finding appropriate Lyapunov functions, 
in the general casej the ingenuity of the investigator is the sole 
means of constructing an appropriate function. 

In synthesizing a control r to make the equilibrium of the equation 

x = f(x, t, r) (III. 3) 

stable, the situation is somewhat altered. A Lyapunov - function candidate 
is first selected, its derivative found, and a control is selected to 
make the derivative negative semi-definite or definite. With this 
procedure, ingenuity is required additionally in the choice of control. 

The next section deals specifically with the question of synthesis. 
Suffice it to say here that with the synthesis technique as presently 
developed the derivative of V is negative definite in some of the 
parameters over which V is defined but only semi-definite over all the 
parameters. This involves the stability of non-compact manifolds. 

One of the few results in the study of stability on a non-compact 
manifold is the following [25]. 

Assume for the system 

x = f(t, x, <}>) 

<f> = g(t, x, <f>) 

that f is bounded for bounded x and r and all t >_ tQ,and that there 
exists a function V(x,i}>) satisfying 

1. V(x,4>) positive definite with continuous first partial 
derivatives 

2. V(x,<f>) -*» as 1 | x [ ! 2 + IUM 2 

3. V(x,$) £ - W(x) + h^OqCx.i})) + h 2 (t) V(x,<fi) 


where 
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i) W(x) is continuous and positive definite 

ii) q is continuous 

iii) |h^(t)| dt < o» for i - 1,2 

0 

then the state x - 0, <|>=0 is eventually stable and, corresponding to each 
t > 0, there is a T t such that | | x(t Q ) | | 2 + I | y ( > | | 2 < c 2 for some 
t ^ £ T implies <j>(t) is bounded and x(t) -*• 0 as t -* ®. 

If, in addition, 

4. for some K > 0 and some 0 < a < 1 
|q(x,(j>) | £ KV a (x,<t>) 

then all solutions 4>(t) are bounded, and all x(t) -*• 0 as t -*• 00 . 

3. 3 Synthesis Technique^ 

This section surveys the literature devoted to the synthesis of 
mode 1-t racking adaptive systems based on application of Lyapunov’s 
second method. In the early work [26] - [34], the model tracking 
problem was approached by using the sensitivity or gradient approach, 
without assurance of global asymptotic stability. Rang [35], Shackcloth 
and Butchart [36, 37] and Parks [38], were first to employ the Lyapunov 
design in finding an adaptive control law which guaranteed global 
stability. It is the purpose here to introduce the basic synthesis 
procedure, and to critically review extensions to the theory which 
have appeared since 1966, relating to: design for relative stability, 

reduction of order techniques, design with disturbance, design with 
time variable parameters, multivariable systems, identification, and 
an adaptive observer. 

* This section exclusively used underscoring to indicate vector for 
purposes of clarity. 
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Synthesis Using Lyapunov ' 3 Second Method 

The basic problem to be considered in this section is that of 
designing a model tracking system for stability without specifying 
exact values of the plant parameters. Lyapunov's stability theorems 
offer a means of synthesizing various control laws which offer possible 
solutions to this design problem, the particular solution depending 
in part upon the form of the Lyapunov function selected. In this 
section the rudimentary ideas involved will be introduced in a somewhat 
limited context. In subsequent sections elaborations on the elementary 
theory will be discussed, indicating some practical design considerations 
as well as defects in the method. 

The concept which is central to adaptive schemes to be discussed in 
this section can be explained with reference to the model tracking 
system in Figure 3.2, for which the state equation of the stable model 
is given by 

+ Bip (model) ^(0) = y° 

(111. 4) 

and that of the time-invariant plant by 

x = A*x + B*u. (plant) j<( 0) = x° 

(111. 5) 

Here y = {y^}, x. = are n dimensional state vectors, and r_, 11 

are m dimensional control inputs. A*, B* contain unknown coefficients. 

If the differential equation of the tracking error (e_ = y^ - x) is now 
written in the form 

e_ = Ae + f (III. 6) 

where f = (A - A*)x + Br - B*u, then the control objective is to 
manipulate f in some way so that lim e(t) = 0_. To this end we introduce 

t'X*> 



ADAPTIVE 

CONTROLLER 


Figure 3.2 

Model- Reference Adaptive Scheme 
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the positive definite function 

V = e_ T Pe + h(‘l>,4') (III. 7) 

where <f>, ¥ are matrices of parameter vectors Ju , jjju to be defined. Then 
along the trajectory of (III. 6) we obtain for the time derivative of V 

V = -e^ Qe_ + 2eJ. P f + h ( j j j _ 8 j 

where 

-Q = A T P + PA. (III. 9) 

T 

By a theorem of Lyapunov [39], with any Q = Q > 0 , it follows that 
P = P T > 0 is a unique solution to (III. 9) iff A is a stability matrix, 
as assumed. 

Using the classification suggested by Phillipson [40], we will 
introduce two methods which have been reported for causing e_ -> 0_. 

Input Modification 

This scheme uses the solution obtained with h_ = 0_. Although it is 
not in itself useful in synthesizing an adaptive control law, i. e. one 
in which a set of parameters are automatically adjusted so as to reduce 
the tracking error, it has been used to advantage in solving certain of 
the design problems to be discussed in the survey. 

With h = 0, asymptotic stability in e_ will be satisfied if [41] 

e_ T Pf = 0 for A - A* = 0 

^otherwise. (III. 10) 

This inequality cannot be satisfied except in special cases depending 
on the system structure. In some restricted cases, such as if (III. 4), 
(III. 5) are in phase variable form, a solution exists. In this case 
u becomes a scalar, B = b , and b^, f^ are the only nonzero elements of 
b, f respectively. We then have the simplification 
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£. Tp l = <t\> f n 

where p is the nth column of P. Writing 
— n 

f = f' + b u, 
n n n 

and assuming that b R > 0 , we see that conditions (2.7) are fullfilled 
if 


N 


| f ' /b | 

- n n 


T 

sgn u = sgn e p^, e_ 4 0_, 

as might be realized by a switching function. Solutions of this form 
have been reported, together with design considerations [42,43]. 


Feedback Syntheeid 

This scheme differs from input modification in that parameters 
in the system are adjusted continuously so that in the simplified case 
treated here e_ -> 0_. 

In feedback synthesis, we write for (III. 7) 

T 2 T ?? T 

V = e‘Pe + l ft. + l (III. 11) 

i=l ” 1 " 1 i=l _1 1 

wherein <|>. , _j|u are misallignment parameter vectors to be defined in terms 
of the elements of the matrices A- A* and B-B* which express the mis- 
allignment between the model and the plant. In this case (III. 8) 
becomes 

V = -e T Qe + 2(e T PF + £ ft. + £ ft.). (III. 12) 

1=1 1=1 

T 

Let E define the whole state space with _£f.E, where is defined by £_ = 

T T T T T 

[e , , ..., , i|u , di ]. Let E.eE, where E is the n dimensional 

— 1 * -4L — n -Mn x X 

sub space with ocE^. Clearly V in (III. 11) is positive definite in E. 
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The basic idea in feedback synthesis is to specify (j^, in 
(III. 12) so that 

e*Pf + l $:<}>. + l <J>V = 0 (III. 13) 

i=l ~ 1 “ 1 i=l " x 1 

and consequently 

V = - e T Qe (III. 14) 

Since V is only negative semide finite in E, but negative definite in 

E^, we may conclude from the theorems of Lyapunov [39] that the equilibrium 

at e = 0 i s asymptotically stable, and the equilibrium at 5. = 0_ is 

stable. It follows in the present formulation that e_ -+ 0_, and that 

the missallignment parameter vectors are bounded. It will be shown 

in certain cases that 0 if the frequency content of r is rich 

enough [44, 59]. 

In implementing the controls to satisfy (III. 13), there are two 
schemes which will be described in this survey as direct and indirect 
adaptation. Direct adaptation assumes that plant parameters are adjust- 
able. Indirect adaptation requires that adjustment take place external 
to the plant. 

Direct Adaptation 

In this scheme u = r in (III. 5). 4> and ¥ are in turn defined by 

$ = A-A*, = B-B*, with columns and iJk respectively. Then (III. 6) 

becomes 

e = Ae + f (III. 15) 

wherein 


f = 4>x + Yr. 


It is seen that (III. 13) can be satisfied if 
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*J = - e T P Xi , (i=l,...n) (III. 16) 

*T t 

= - e Pr^, (i=l,...m). 

If adaptive control (Figure 3.2) is the objective, then elements of A*, B* 

should be adjusted, in which case (III. 16) becomes 
• yT T 

a!* = e Px. , i=l, . . .n 

(III. 17) 


= e T Pr. , i=l,...m. 

— i — i* * 

Here it is assumed that A, B are constant. In the identification section 
control is applied to matrices A, B instead of A*, B*. 


Indirect Adaptation 

Whereas the adaptive control law in (III. 17) can be implemented for 
the multivariable system if direct adaptation is possible, restrictions 
must be placed on the form of the state equations in order to apply 
indirect adaptation [34, 45]*. 

Assuming that the elements of A*, B* are not directly adjustable 
it becomes necessary to modify the system. Consider the single-input 
single-output plant defined by 

*1 _ k* 

U s 11 + a* s n ^ + . . . + a* 
n 1 

By introducing k^ t k , k^ , . . .k as adjustable parameters as in Figure 
3.3, it is seen that the compensated system has been cast into the form 


x = A*x + b*r 

* As discussed in the section on reduction of order, if if is desired 
to require convergence of fewer than all the states, Iho restriction on 
form can be relaxed if there arc l.h.p. zeros .in the plant transfer 
function. 
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Figure 3.3 

Model -Reference Adaptation by Feedback 
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where 

, b* T =C0,...,0,b* n ], 

with b* = k k*, and a*. = -a’? + k., i = l,...n. Thereby the problem 
nr mil* 

is amenable to direct adaptation by application of (III. 17). For the 
single-input case it is noted that only n coefficients in A* can be 
adjusted. The multivariable problem suffers restrictions also [45]. 


A* = 


« 

• 

• 

• 

• 

i 



• • « 
f 

nl 

■ • • • 
» « * 

• 1)4 

a* 

♦ 


nn 



Degree of Stability - Improved Speed of Response 

The adaptive step response [36] has been helpful in analyzing the 
relative stability of adaptive systems. With the aid of this concept 
Phillipson [40] showed that it is possible in case of an adaptive gain 
to improve the relative stability by appropriately modifying the adaptive 
control law. Gilbart and Monopoli [46] formalized the synthesis pro- 
cedure by redefining the V function in (III. 11). 

In the ensuing discussion let the error equation be defined by 


" 0 l“ 


1 

o 


+ 


; a o " a i 


(k -k*)_ 


(III. 18) 


where k* is the only adjustable parameter. If (III. 11) is written as 


V = e T Pe ♦ h, • const. (III. 19) 

h l 1 

then (III, 8) becomes 

V = + 2( LE2 (k-k * )r + JP ) (III. 20) 

T 

wherein p 2 = Ep 12 p 22^* P foun<i according to (III. 9), In this 



39 


case, with tj> = k-k»' s , it is seen that (III. 13) is satisfied if 

k* - (p^e^^ + f*22 e 2^ h l r * (III. 21) 

If r is assumed to be a step of magnitude R, then differentiating 
(III. 18) and using (III. 21) leads to the characteristic equation 

S 3 + a^S 2 + a Q S + (p l2 + p 22 S)h 1 R 2 = 0 (III. 22) 

The roots of this equation characterize the adaptive step response. A 

typical root locus, as shown in Figure 3.4, demonstrates that the relative 

2 

stability is degraded with increasing R , even though the system by 
design cannot be unstable. 

2 

As a means of improving the relative stability with increasing R 
Phillipson modified the adaptive rule in (III. 21) by setting u = k*r + u^, 
and using u^ to insert input modification. Thus, with u^ = yk*r, (III. 8) 
becomes 

V = -e T Qe ~2(e T £ 2 ) 2 h^ 2 . (III. 23) 

. 2 

The effect has been to make V more negative with r . It is also 
instructive to examine the adaptive step response. The equation corres- 
ponding to (III. 22) is 

S 3 + a x S 2 + a Q S + (p 12 + p 22 S) (1 + yS^R 2 = 0 

(III. 24) 

2 

The root locus indicates an improved relative stability for large R 
(see Figure 3.5). 

More in the spirit of involving the Lyapunov function in the 
synthesis procedure, Gilbert and Monopoli [46] have proposed modifying 
the V function in (III. 11) so that the desired result is obtained more 
routinely. The concept will be illustrated using the system equation 
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Figure 3.5 


Improved Degree of Stability 
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(ill. 18). According to [46] we introduce the modified V function 

_ (ip + h z) 2 

v = e_ pe + r — . (III. 28) 

h 2 

(III. 8) now becomes 

V = -e^Qe + 2e^P 0 (k-k*)r + ~ {# + h,ipz + h.,zip + h 2 zz). 

— — 1 h„ 1 1 1 


(III. 29) 


If we equate for this example 


z = e p 2 r 
ip = k-k* 


(III. 30) 


ip = -hjZ-h^z 


then (II I. 29) becomes 


• T TO 

V = -e/Qe_ -2h 1 (e_‘p 2 r) . 


(III. 31) 


This is seen to be identical to (III. 23). For the adaptive control, 
we have from (III. 30) 


e T p 2 rdt+k(t 0 ). (III. 32) 

The general matix formulation of this scheme for the entire 
parameter set <I>,T is given in [47], together with simulation results 
showing that improvement in convergence time can be obtained. 


k* = 


h !±% r + 


Reduction of Order 

The basic model-reference Lyapunov adaptive law requires measurement 
of the entire error vector for its implementation. If all the state 
variables of the plant under control are not available, then the basic 
adaptive law is inadequate since ignorance of parameters and inherent 
system noise may prohibit their generation by an observer or by differ- 
entiators . 
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To overcome this practical problem investigators have attempted 
to find adaptive laws that require a minimum of state variable measurements. 
The first such attempt by Parks [38] was for the restrictive system shown 
in Figure 3.6 in which only the constant plant input gain Ky is mis- 
matched to model gain K. The adaptive law adjusts K c so that the error 
vanishes. Parks use of Kalman's lemma [48] subsequently extended by 

Monopoli [49] using the Kalman-Meyer lemma [50], has shown that the 

-1 

adaptive law K = X e n r, in which only the output error e 1 appears, is 

O JL x 

sufficient for asymptotic stability of e^ if 

1) is a positive real function (III. 33) 

2) [100 .. 0] AbjM 

N(s) 

where — ^ y - is the transfer function representation of the plant equation 

x = Ax + br. If 2) does not hold but 1) does, the set V = 0 must be 
examined to insure asymptotic stability of e. 

Monopoli [49] extended the criteria to nonpositive real transfer 
functions that can be made positive real by multiplying by a polynomial 
in s with roots of negative real parts. In doing so, the resulting 
adaptive law requires n-m-2 derivatives of the output error e^ where n 
is the number of plant poles and m is the number of plant zeroes. 

In the more general case where adaptation of both plant poles 
and zeros are desired, the basic indirect adaptive scheme fails (but 
not direct adaptation) even with full state measurement available. This 
is seen since, referring to Figure 3.7 with D(s) = 1, the error 
equation 

N(s)o 1 = [Q(s)-N(s) + P(s) H(s)]x 1 + [M(.*;) - l*(s) C.(s)]r 


(III. 34) 



Figure 3.6 
Input Adaptation 
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reveals H(s), a polynomial, may have at most only n-m free parameters 
so as not to increase the order of the nth order polynomial Q-N+PHj 
consequently there exists no steady-state solution to the problem of 
adjusting n parameters in Q-N+PH state feedback. 

Monopoli and Gilbart [51], however, have employed dynamic feed- 
back on a reduced state of order n-m-1 to accomplish adaptation with 
plant zeroes. Moreover, they have shown that the plant matrix A* need 
not be of any particular form; nor must A* be stable nor C*(sI-A M ) B* 
be positive real; and the output matrix C* need not be known. 

Their basic idea is for D(s), after adaptation, to cancel P(s), 
with the model zeroes placed in cascade with the plant by G(s). Due 
to the cancellation, the zeroes of the plant necessarily must be in the 
LHP. 

The vector error equation (III. 6) is "collapsed" to yield a scalar 
error equation in the output error e^ from which the synthesis proceeds: 


f % n— 1 (:\ n-1 (i) m ^ \ m A i 

< n) . I a 4 1 * = I 4a x + l Ab J ) t I b u 

1 i=0 i=0 i=0 i=0 


(i) 


(i) 


(III. 35) 


Note that the output error, defined as the difference between the scalar 
model output and the scalar plant output, is always available for 
measurement by definition. 

For clarity in illustrating the synthesis procedure, a 2nd order 
system with one zero will be treated here. For this system, (III. 35) 
becomes 

(s^+a^s+a^Je^ = ( Aa^s+Aa Q ) x^ + Ab^r + (s+b^)u 


(III. 36) 
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in which initial conditions have been ignored and Ab^O and b^=l for 
simplicity in this treatment. Dividing (III. 36) by stc, 0<c<a^, and 
taking the Laplace inverse transformation yields 

®1 + ( V c)e ! = C c (a 1 -c)-a 2 ] ( f,- 1 (!i^) + Aa^ 

+ CAa o - cAa i ] ^ _1 < + % &' 1 (—■) 

+ u + Cb 0 -c] ^ _1 C“^r c ). (III. 37) 

Now if u is chosen as u = E k.v where v. are each of the terms on the 

i i l 

right side of (III. 37) (i.e. y ± = &' 1 ( !i_) , v 2 = etc.) then 

(111. 37) has the form for which the indirect adaptation scheme can be 
applied with the important difference that the resulting adaptive 
law contains only e^ and not its derivatives. 

In general, a division polynomial, such as that which produced 

(111. 37) , should be of order m with zeroes chosen so that the left side 
of ( III. 37) is stable. Then the left side contains n-m terms, so the 
resulting adaptive law contains n-m-l derivatives of e^. 

It should be pointed out that since vector state information is 
destroyed in collapsing the error equation to (III. 35), convergence of 
(output error) does not in general imply that the state variables 
converge. If the output matrix is known and A is in companion form, 
then convergence of e^ implies convergence of the first n-m state 
variables. 

At present, indirect adaptation cannot take place when there is a 
right half-plane zero in the system. 

Effects of Disturbance in Adaptive Control 

As noted in the synthesis section , if disturbance is neglected 
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* 

then, according to (III. 14), V becomes negative definite in and 
negative semi-definite in E. However, it has been demonstrated, and 
in some cases proved, that the input to the system can be so chosen that 
the solution V = 0 can be satisfied only at the origin of the entire 
E space. 

Recently Lindorff [523 and Narendra et al. [53] have considered 
the effect of disturbance upon stability. In [52] it is shown that, 
even though e_ remains bounded (theoretically), disturbance can cause 
the adaptive gains to be unstable (unbounded). In [53] a modified 
scheme is derived such that V is strictly negative in E outside of some 
bounded region about the origin, thereby guaranteeing boundedness in E, 
without placing special requirements on the input signal. 

In [52] the effect of disturbance d and incomplete adaptation has 
been examined with reference to the single input plant described by the 
equation 

jk = A*x + b*(r + u^) + d. (111,38) 

The tracking error in this case defined by 

e = Ae + f i + fg , f x ^ = f 

where f^ includes all adjustable parameters (although these need 

not be the entire set of unknown parameters), and f^ contains the remaining 

terms in _f, including d_. The adaptive controls when applied to this 

* 

problem cause V to be reduced in the form 

V = -e T Qe + e T Pf 2 . (III. 39) 

ft 

Since V in (III. 39) is strictly negative outside of some bounded region 
about e^ = 0^ in E^, and indefinite elsewhere, e^ will ultimately lie 
inside a calculable region about the origin. However, due to the 
presence of f., V is indefinite in E, and stability in E can no longer 
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be guaranteed. This has been demonstrated for the case in which (III. 38) 
is in phase variable form [523, and d^ and r are constant. It is shown 
that parameter errors can be unbounded if the disturbance is opposite 
in sign to r. 

Narendra et al. [53] have considered the problem of synthesizing 
an adaptive control law which guarantees boundedness of the errors 
when disturbance is present. Since their method also allows for time 
varying plant parameters, we shall include this degree of generality 
in the discussion, although the time variable case is treated in more 
detail later. For simplicity of exposition consider the first order 
differential equations 

(III. 40) 

(plant) x = -(a*+k)x + r + d, a* = a*(t) 
in which k is an adjustable parameter, d is a disturbance entering the 
plant, and r is the common input. The tracking error (e = y - x) is 
governed by 

e = -ae + $x -d (III. 41) 

with 4> = -a + a* + k. If we now choose the positive definite form 


(stable . 

model) y = -V ♦ r 


V = ^ (Ye 2 + $ 2 ) , Y > 0 (III. 42) 

and introduce the modified adaptive control 

k =-Bk -yex (III. 43) 

the equation for V becomes 

V = -yae 2 -B$ 2 + (3(a* -a) + a*)$ -yde. (III. 44) 

From this result it follows that boundedness in e, $ is guaranteed since 
V contains a negative definite part in e and <j>. These quadratic terms 
control the sign of V for large enough values of |e| , |<J>| , if (a* - a), 
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d and a* sire bounded. This result in turn depends upon the introduction 
of B in the modified adaptive control law (III. 43). 

"th 

This design has been generalized [53] for the single-input n 
order plant. Simulation results indicate that, in the absence of noise 
disturbance, best results are obtained with B = 0 and with the input 
rich enough in frequency content to assume asymptotic stability in the 
entire E space. 


Time-Varying Parameters 

For the time-varying plant 

x = A*(t) x + B*(t)(r-u) (III. 45) 


to behave as a time-invariant model requires an indirect adaptive law 

/ 

that depends upon the time derivative of an unavailable quantity if the 
synthesis is followed. Porter and Tatnall [54] have pointed out that 
this term may be ignored under some conditions on A*(t) and B*(t) for 
eventual asymptotic stability of e. These conditions are restrictive, 
however. 

In the more general case, use of a new adaptive law due to Narendra 
et al. [53] leads to the determination of Lagrange stability bounds 
whenever the time varying plant parameters satisfy certain restrictions. 
Reference is also made here to the next section. 

To illustrate their adaptive scheme, consider a first-order time 
varying plant (111,45) with B*(t) = b*(t). The corresponding error 
equation with u = k^ + k 2 r is 

4 - ae - (a-a*(t) + b*k^)x + (b-b*(t) + b*(t)k 2 )r 


= + 4> 2 r 


(III. 46) 


a < 0 
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Using the adaptive law [53] 
=*gk^ - xe 


(III. 47) 


k 2 = - Bk 2 - re 

the Lyapunov function may be shown to be (with b*(t) chosen as in (III. 49)). 


V = b*(t) e 2 + + $ 2 

V =+b*( p- + 2a) e 2 + 2(^- -g) <)> 2 + 2(j^ -g)^ 

» * 

1 Vs ft 

+ 2 (a* -a) ( ^ - 2b(p- -g)^ -2 a** - 2gb** 2 

(III. 48) 

Now if the following restrictions are placed upon the parameters 

(i) 0 < b^ <_ b*(t) <_ b 2 < » 

(ii) _ «o < a*(t) <_ a 2 < «* 

'll *• 

( iii) - ® < b 3 b 4 < a 2 (III. 49) 

(iv) g > b^ 

(v) | a* | <_ a 3 

The function V can be shown to be negative outside of a region in 

the space (e, *). Bounds on the region of attraction can therefore 

be found by determining the smallest ellipse V = C that encloses the 

* 

region of indefinite V. 

It is noted that (III. 47) does not produce an asymptotically stable 
error even in time-invariant systems unless g = 0. This follows from 
the observation that the adaptive parameters k cannot converge to a 
non-zero value whenever the error e vanishes simultaneously. 

Narendra [55] extended the above technique along these lines for nth 
order systems. 

Monopoli , Gilbart and Thayer [49] produced a "practically Asymptotically 
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stable" system of Figure 3,4 when only the time-varying plant input 
gain K y (t) is adapted. The plant must have the same general attributes 
as in the section entitled Degree of Stability, They found, using a 
Lyapunov function V a 1/2(A^wJpw + A(t) <$?), that practical asymptotic 
stability of e is attained with an adaptive law k = A.w^pbr +6K(K-K K„)|r| 
where iv is related to n-m-1 derivatives of e^, n 6 m defined as in the 
Degree on Stability section. The region of attraction is inversely 
proportional to the magnitude of 6 and r. 

The reduction of order with time-varying parameters was extended by 
Gilbart and Monopoli [56] to include adaptation of time-varying plant input 
coefficients and characteristic polynomial coefficients. A scalar error 
equation in e^ analogous to (III. 35) but with time-varying coefficients 
on the right side is assumed. For clarity, a second order example is 
demonstrated here. Suppose first that the second order plant is without 
input derivatives. After dividing by plant input coefficient b*(t), the 
scalar error equation is 


1 , db . 4a 0 

PItT 'WiVi 1 = PTt7 r + psTtT x * TO x ' u > b “ (t)>0 vt> °' 


This can in turn be put in' the form 


^ e i +a q®i +a o e i^ = + Cfj+g^t)]* + [f 3 +g 3 (t)]x - u 

(III. 50) 

in which the coefficients have been broken into time-invarient parts f 
and time-varying part g. Choosing u = (k^+k®)r +(k^+kf)x + (k^+kf)x 


and 
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•f T 

*1 * V V 


■f T 

k x = -a^e P 2 x 


(2 " 1) i = 2,3 


(III. 51) 


• ® .-Bj. 

kf • H x sat[ 

if = H sat t~- e T p x* S_1 b i 
i 


2,3 


then the function V = e Pe + ][ (f. + k.) has a negative derivative 

i „ - 1 1 

1=1 

outside a region whose boundary is directly proportional to the bound 
on [g^(t)| and b(t) and inversely proportional to 8^. Consequently 
(III. 51) delivers strong practical stability of e. 

It is shown also by Gilbart and Monopoli (56] that a reduction of 
order technique similar to that in the Reduction of Order section, but 
modified to account for the time- varying nature of the scalar error 
equation (III. 35), can be applied so that the resulting equation is in 
a form similar to (III. 50) in order that adaptive laws like (111,51) 
may be used to produce a strong practically stable system. The reduction 
of order allows only n-m-1 derivatives to be used in forming the adaptive 
laws. 


Adaptive Control of Multivariable System 

It has been noted by Winsor and Roy [34] that the adaptive control 
law in the form of (III. 17) can be implemented for the general multi- 
variable plant if the plant parameters are directly adjustable (direct 
adaptation). The practical case in which feedback control signals are 
used to implement compensation (indirect control) warrants attention, 
however, particularly for the multi-input systems. 

Starting with (III. 4) and ( III . 5) ,( III . 6) , Lindorff [45] has shown 
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that certain conditions are imposed on the form of (III. 4) (III. 5) in 
order that the Lyapunov design may yield a unique set of controls. This 
may be clarified by considering the term in (III. 8) 


iV = l iVi 

1=1 


(III. 52) 


in which 


n mm 

f i = l ♦i-j*. + l Y r + l b i-jY 

1 j=i ^ D j=i ^ j=l J 


Since P is positive definite, and jk are linearly independent for 
all ij<j . Therefore a different u. must be identified with each f^ in 
generating a particular component of the adaptive control law. It 
follows that not more than m components of _f can be nonzero, and that a 
stable adaptive control law can be realized if (1) there are no more 
outputs than inputs, (2) the state equation is written in partitioned 
phase variable form, (3) the matrices B*, B are in triangular form. 
Extension of the reduction of order technique [51] to the multivariable 


problem has not been reported. 


Identification 

The identification problem can be approached so that the process is 
inherently stable. Lion [59] has derived a very practical solution to 
the problem of identification for single-input, single-output plants, 
with guaranteed asymptotic stability. Kudva and Narendra [57] have 
applied the Lyapunov synthesis method to the identification of time 
variable systems, illustrating an application of direct adaptation. 

Lion uses the so called Generalized Equation Error System 
of Figure 3.8. In this scheme the parameters of H, D are adjusted 

A 

so as to minimize e . A significant feature of the method is that no 
derivatives of u, y are required (G is a low pass filter). 
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Figure 3.8 


Lion's Identification Scheme 
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The scheme is based on the scalar error equation 

e=(D-D)y 1 +(N-N) u . (III. 53) 

in which 

- n . 

D-D = l iy 
k=0 

m* m » 

N-N = l A8 p k 
k=0 K 

with p = d/dt, and u^, are filtered values of u, y. G(s) may have 

n X 

the simple form 1/s . 

If the parameter adjustment law is defined as 

Aa. = -ke(p^y 1 ) p=d/dt 

A6. = -keCp 1 ^) (III. 54) 

and the parameter misalignment vector is defined by 

T 

± - CAa 0 ,Ao 1 ,...,Aa ti _ 1 ,ve 
it is possible to show that the function 

1 T 

V = - H i s a Lyapunov function with 

V = = -ke 2 <0. (III. 55) 

However V in (III. 55) is only negative semi-definite, i. e., e may be zero 
for ^/0_, and is required for identification. By application of a 
theorem due to Lasalle [58], Lion has shown that global asymptotic 
stability will be achieved if u is periodic, and meets certain conditions 
as to frequency content. 

Kudva and Narendra [57] have used direct adjustment of the model 
to solve the identification problem for the multivariable time-variable 
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plant. In constrast to Lion, all plant states must be known. No 
restrictions are placed on the form of the state equations. 

Given the state equations 

Plant x = A*x + B*r 


(III. 56) 

Model y = Cy + (A-C)x + Br 

where C is a stability matrix, and A, B represent the model, then the 
error equation (e^ = y-x) becomes 

£ = Ce. + foe + Vu (III. 57) 

in which $=A-A*, T=B-B*. It is seen that if the parameter mis- 
alignment matrices approach zero. 


Following the scheme outlined in the Time-Varying Parameters 
section, for a single-input plant, the direct adjustment scheme for a 
time-variable multi-input plant becomes 


a, 

-T 1 


-R.a, -Fex. 
l— x — 1 


(III. 58) 


b. - -S.b. -Perj 


where it is observed that (III. 57) is a modification of (III. 17). R. 

i ! 

are any positive definite diagonal matrices, and are introduced so 
that V will contain/ftegative definite component in E(See the Time- 
varying Parameter section). It is noted that the model parameters 

» rather than the plant parameters, are adjusted in this case. 
Computer simulation of^ fourth-order two-input plant is shown to yield 
good results. 



CHAPTER IV 


THE SINGLE- INPUT SINGLE-OOTPUT 
ADAPTIVE OBSERVER - PART I 

4. 1 Motivation for an Adaptive Observer 

In this chapter the first adaptive observer, which was developed 
by this author, is described. In the next chapter, the subsequent 
development by other investigators based upon the formulation described 
herein is detailed. 

The motivation of the adaptive observer rests upon the necessity 
of certain knowledge of the system parameters for formulating a non- 
adaptive observer. This may be seen with reference to equation (II. 6 ), 
copied below 

e = Fe + (F-T -1 AT + GCT)x + (D-T^Bjr (II. 6 ) 

As shown in section 2.2, the above equation is made asymptotically 
stable by defining 

FT -1 = T _1 A-GC, i.e. T _1 AT-GCT=F (II. 7) 

D = T _1 B 

and choosing the eigenvalues of F to all have negative real parts by 
choice of G. 

If the elements of the matrices A, B, or C are unknown, then the 
equations (II. 6) cannot be assuredly satisfied. In this case, (II. 6 ) 
becomes 

e - Fe + 4»x + Tr 

for which <J>^0 and Vi 0. Thus, even if F may be chosen to be an 
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(IV. 1) 
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asymptotically stable matrix* the error e in general does not vanish 
whenever the system is excited by a non-vanishing r. 

Since e is defined as 
e - z - x, 

the condition that e does not vanish implies that the observer state z 
does not eventually reproduce the system state x. 

It is therefore proposed that the matrices $ and V be adaptively 
adjusted to zero during system operation. Since (IV.l) is then 
asymptotically stable (for suitable choice of F) when $ = ¥= 0, the 
observer state becomes equal to the system state. 

Moreover, since ♦ and S' are defined here as the ignorance in 
equations (II. 6) when A, B, and C are unknown, adaptively reducing 
4> and S’ to zero allows the values of A and B to be ascertained if C 
is known. Thus in addition to adaptively generating the state of an 
unknown system, the full order adaptive observer identifies the para- 
meters of the unknown system. 

As will be seen, the adaptive observer converges to a Luenberger 
observer, implying the noise suppression characteristic, of the 
Luenberger observer is retained in some measure in the adaptive observer. 

4.2 Development of the Adaptive Observer 

The Luenberger observer [ 2]- [4 ] allows extraction of the state 
of an observable linear system when given (1) the system input, (2) the 
system output, (3) the form of the system, and (4) the parameter values 
of the system. In those cases for which the system parameters are 
unknown, the state observation is subject to error. Some previous 
investigators of parameter ignorance in observers [60], [61] alleviate 
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to some degree the observation error, but they are unable to guarantee 
that the error vanishes or that their computational algorithm converges 
when the magnitude of parameter ignorange is large. The basics of a 
full order adaptive observer which negates these disadvantages have 
been previously reported [44], The present chapter, following [713, 
considerably simplifies the exposition of the previous paper and extends, 
both computationally and theoretically, the topic of that paper. Briefly, 
the full order adaptive observer for single-input single-output observable 
continuous linear differential systems in the absence of a deterministic 
or random disturbance vector guarantees the vanishing of observation 
error regardless of the size of the constant or slowly varying parameter 
ignorance. The observer parameters are directly changed in a Lyapunov 
adaptive way so as to eventually yield the unknown full order Luenberger 
observer. The observer poles may throughout be placed freely in the 
stable region, and no derivatives are required in the adaptive law. 

The Problem 

A differential system is assumed of the form 
w = Aw + Br, w(0) = w® 
y = [1 0 0 ... 0]w = Cw 

A n x n 

B n x 1 (IV. 2) 

for which only the single-output y = Cw = w_ L is available for measurement. 
It is assumed that a similarity transformation has been made, if 
necessary, so that the single-input single-output system has the form 
of (IV. 2). It is assumed that some or all of the elements of matrices 
A and B are unknown, w° may be unknown, and the pair (C,A) is completely 
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observable. The observer is of the form 

z = Kz + GCw + Dr + Hu, z(0) = z° 

Fnxn G n x 1 

Dnxl Hnxn and diagonal (IV. 3) 

where K is arbitrary and u is a control vector yet to be defined, but 
with the property that u -*■ 0 as t ■> «. The problem is to adaptively 
form a triple (G,D,T) so that the error vector defined as e = z - T V 
vanishes as the system adapts. T is a nonsingular square matrix with 
the property that CT = C. Figure 4.1 illustrates the adaptive strategy. 
It is noted that T ^ between w and x in Figure 4.1 is not physically 
realized. 

The Adaptive Strategy 

The overall strategy for solving the problem is to determine an 
adaptive law for progressively forming the triple (G,D,T). The adaptive 
law shall require that the error between the system output and the 
corresponding observer state variable be asymptotically stable in the 
sense of Lyapunov. This requirement alone does not guarantee that the 
error between the system state and the observer state vanishes, since 
the system output remains unchanged under a range of similarity 
transformations of the system state. In the section entitled "The 
Transformation" it is therefore shown that the adaptive observer 
generates but one of these similar states and that , by introducing the 
transformation matrix T, the system state can always be adaptively 

A 

constructed by the constrained matrix T(t) whenever the system is 
observable, since lim T(t) = T. 

The required adaptive law may be explicitly obtained by the use 
of Lyapunov's direct method. In the section entitled "The Adaptive Law" 
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the equation of error is manipulated in such a way as to obtain it in 
terms of only those variables which can be directly measured without 
recourse to differentiation; the resultant equation is therefore neces- 
sarily defined on a noncompact manifold of the error space. A 
Lyapunov function is introduced on this noncompact manifold, and the 
adaptive law is accordingly synthesized. Theorem 2 expands the 
validity of the law to the compact manifold. 

The Transformation 

Define a transformation x = T~*w so that e = z - x. Then (IV. 2) 
becomes 

x = A Q x + T -1 Br, x(0 ) = T _1 w° 

y = CTx = Cx, A q = T _1 AT (IV.2A) 

and (IV. 3) becomes 

z = KqZ + GCx + Dr + Hu, z(0) = z°. (IV. 3A) 

It is desired for subsequent development that A^ = T ^AT be in the 
"output" form 



wherein the first column contains the system parameters, and all other 
elements are zero, save the super-diagonal elements which are unity. 
The following theorem defines the restriction that must be placed upon 
A so that both A Q = T -1 AT and CT = C. 
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THEOREM 4. 1 [CARROLL ]: Let A be an n x n matrix, C - 11 0 0 .. . 01 a 
1 x n matrix , Aq an n x n matrix in output form. Then there exists 
a matrix T such that A ■** TAJT~ 1 and CT = C iff the pair (C,A) is 
completely observable . 

PROOF; (A,C) is observable and by duality (A^C^) is controllable 
iff there exists a transformation Q such that 


0 

0 


~T -1 

Qa'q 1 


Thus 


-T*» T 
Q AQ = 



cq t =[00 


0 1 ], 


a 

n 
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and let 



Also » 

C(MQ" T ) = C. Q.E.D. 

As a result of the theorem , any observable system (IV. 2) may be 
placed by similarity transformation into system (IV. 2A) with CT = C. 
The elements of T may be unknown since A is unknown. The problem will 
be considered as defined by (IV.2A) and (IV.3A), so that e = x - z 
must vanish. Eventually the problem of contructing w from x will be 

A 

solved by introducing the adaptive matrix T(t). It will be shown that 

<*■ a A 

lim T(t) = T so that w = lim T(t)z = w (in which ft is the observer 
t-+» t-*” 

estimate of w) since lim z = x. 

t - * 06 

After the adaptation of the observer (IV. 3) to the unknown system 
(IV. 2) has been essentially completed, the values of G and D are then 


D = T _1 B 

(t -1 at-k 0 )c t 
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Consequently, the adaptive observer converges to a Luenberger identity 
observer of the transformed system (IV.2A) with knowledge of parameters. 

It is noted that there is no physical realization of matrix T 
between w and x in Figure 4.1. 

The Adaptive Law 

It is now assumed, more for explanatory purpose than actual practical 
need, that some stable "nominal" plant matrix is either known or is chosen 
so that A Q = A Q + AA q , where A Q has all known elements and is in output 
form. Consequently, AA Q contains all zero elements, except for the 
left column which has elements that are to be adapted. Letting 
e = z - x, the vector error equation is 

e = Ke + (K + GC - A Q - AA Q )x + ABr + Hu, e(0) = e° 
where AB = D - T ^B. A theorem of Luenberger [ 2 ] allows the eigenvalues 
of Aq - GC to be arbitrarily placed by selection of G (with the sole 
exception that A^ - GC cannot have the same eigenvalues as A^). For the 
above error equation, let G = G^ + G^ and K = A^ - G^C. Then as a 
result of the theorem of Luenberger and of the special forms of A Q and 
C, the vector error equation is 

e = K Q e + (GjC - AA Q )x + ABr + Hu (IV. 4) 

where is an arbitrary stable constant matrix in output form with 
eigenvalues differing from A Q . The adaptive strategy is to change 
Gj^ and AB to eliminate the influence of x and r in (IV. 4); since 
by assuming K Q is a constant matrix, changing is equivalent to 

changing G and will be considered as such in the ensuing. 

For notational convenience in the next sections, the following 


definitions are made 
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G " ^-1 g n-2 ®n-3 *** g 0^ ‘ 

H = diag [0, h h h ] and n x n. 

rw n-o o 

n = order of plant. 

m = number of zeros in system transfer function. 

The error between plant state x and observer state z may be 
measured only by the scalar state variable e 1 = z. - y = z - x . To 
insure that only available measurements are called for in the adaptive 
laws, a differential equation of first order in terms of the error 
variable e^^ is derived by using the so-called reduction of order 
technique similar to that of Giibart and Monopoli [51]. To this end, 
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(IV. 4) is first '’collapsed" to yield the equivalent scalar form of 
the differential equation given by 


n 


l *,.<*> =Y T t 1 1 «, 

i=0 1 x j=0 i=0 


* » . i 

1+3 


m tn — ~i , , / » \ / • \ 

+ I l ( X I ] ) 6 1+j (l V^> 

j=0 i=0 3 


n-2 


+ V h.u. 
i=0 1 1 


(i) 


(IV. 6) 


where (•)'' 1 ^ denotes the ith time derivative of (•). 

Equation (IV. 6) can now be reduced in order by first altering 
its form and then appropriately defining the n-1 elements of the 
control vector u. Thus, if is taken to be a real and arbitrary 
characteristic value of and p - d/dt, then (IV. 6) can be written 
in the form 



(IV. 7) 


where it is understood that the left side of (IV. 7) is a partially 
factored form of the left side of (IV. 6). The right side of (IV. 7) 
has likewise been constructed to be equivalent to the right side of 
(IV. 6). The underlying purpose is to form f and f p from measurable 
quantities so that a u can be realized which satisfies the equation 


n-2 


f + f + Y h.u/ 3 ^ = 0 

* r jS 0 3 3 
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subject to the condition that lim u(t) = 0, It follows, disregarding 

t-H» 

initial conditions, that (IV. 7) can be reduced to the form 

n+m 

(p + A )e “ l <i.v 
1 i=0 1 1 


where and are appropriately defined to ensure the desired asymptotic 
behavior of u. 

The defining equations of v. are given by 


l a . v . ^ = x/ 1 *, i = 0, 1, 2, n-2 (IV. 8) 

j=0 3 1 


\ / * v 

l a.v = r U-n , i = n, n+1, n+2, ..., 2(n-l) (IV.8A) 

j=o 3 1 


V 2n-1 ' r 


where it is seen that each v^ is obtained from or r by low-pass 
filtering, and hence is realizable. 

The defining equations for are given by 


*i = 


a. ^ a, a . , 
l i n-1’ 


n-1 3 


^i-n * 


i = 0, 1, 2, ..., n-2 
i = n - 1 

i = n, n+1, n+2 m+n < 2n-l. (IV. 9) 

However, should m=n-l, then (IV. 9) should be corrected to the extent 


that 
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i-n a i-n ^n-1’ 


n-1, 

i = n,n+l, n+2, . 2n-2 
i = 2n-l. 


(IV.9A) 


These have been chosen so that the terms in f and f contain only 

x r J 

derivatives of <J>^ as required, so that f and f may be realizable. 
Although (J)^ is not directly measurable, it will be seen that ^ is a 
measurable quantity to be defined by the adaptive algorithm. 

The resulting expressions for and f become 
n-2 k-1 .j /. . .v 

f x ■ l I — . u 

k=l j=0 dt 3 k 

n-2 n-2 n-2-j ,j .... 

-I l l a i +j+ i — 5 < IV *io) 

k=0 j=0 i=0 1+3+1 dt 3 K k 


m k-1 j 

f r = l I — , » ntk 

r k=l j=0 dt 3 n+k 




n+m n-2 n-j-2 j 

■l l t a iH +1 — 1 C V V* 

k=n j=0 i=0 1+31 dt 3 k k 


(IV. 11) 


However, if m=n-l, then (IV. 11) should be changed to 
n-2 jj . /, . 


n-2 

k-1 

• 

d 3 

• 

f = l 

r *• 

k=l 

l 

j=o 

d? 

n 

£ 




2n-2 

V 




L 

k=n 

It is further 

noted 

that , 


-II I a. Cv ]. 

k=n j=0 i=0 1+3+1 dt 3 k k 

(IV.11A) 

It is further noted that, since ^ is the change in parameters due 
to adaptation, as adaptation is completed <^->0,0 <_ k < n + m, and 
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consequently, lim u. = 0. 


t-*» 


1 


As noted, the implementation of u_. reduced (IV. 7) to 

n-1 . n-1 . rn+m -| 

(p + »,)(_! a p l )e = < I >/) l Vi J- 

1=0 1=0 u 1=0 

/ 

Taking the Laplace transform of (IV. 12) and dividing by 


n-1 

\ a.s 1 yields 
i=0 x 


n+m 

(s + V s i = .1 *i v i 

L i=0 u 


oC 1 (ini 


itl al conditions) 
n-1 

l V 1 

i=0 1 


(IV. 12) 


(IV. 13) 


for which follows 


n+m n-1 

e. h X.e -i = I <t>jV + l iK exp C-X.t] (IV. 14) 

1 1 1 i=0 i=2 1 

where ij^.are unknown constants or time-dependent functions depending 
upon the initial conditions and {A^}, the set of characteristic values 
n-1 

of £ a.s, 
i=0 1 

A Lyapunov function is now to be formed so that stability of the 
adaptive observer may be assured. To this end, a positive definite 
function of the measured error e^ and the unknown parameter errors 
<p . is defined as 

l 


n+m 


v ■ I ( Vi + 1 V 2 i> 


i=0 

Following Shack cloth [37], V can be made to be 

• 2 n r 1 

V = + e 1 1 ^ exp[-A.jt] 

i=0 


when 

m 

d>. = - v.e. , 0 < i < n + m. 

H m. l 1 — — 

l 


(IV. 15) 


(IV. 16) 


(IV. 17) 
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Other adaptive laws can easily be chosen instead [57 ]. 

Implementation of the adaptive law in (IV. 17) can be accomplished 
by reference to (IV. 9) and to the definitions of the variables a. 
and 6^. For example, 

m 

♦n-l * Vl * Vl = - W~, Vl 

n-1 

m 

* = a 0 - a -2a = g. 0 _ - — x e 

iw n-2 n n-l ti- 2 n-2 m , 11 

n-l 


m 

v „e, , etc. 

m „ n-2 1* 

n-2 


in which may be ascertained. 

« 

From the form of V, is stable in the sense of Lagrange with 
the region of attraction determined by the unknown constants ^ and 

the decaying exponential time function. Clearly, the region of 

v 

attraction shrinks exponentially with time and eventually vanishes; 
consequently, is eventually asymptotically stable and lim e^ = 0. 

All derivatives of e^ must vanish in the limit as well since the scalar 
error equation (IV. 14) is linear and of first order and possesses 
finite frequencies. 

However, the Lyapunov function (IV. 15) is defined on a noncompact 
manifold. Consequently, is shown to be (eventually) stable but 

not necessarily asymptotically stable [5]. It is evident from (IV. 4) 
that each must vanish by adaptation in order to observe the correct 
plant state. Theorem 2 defines the restriction placed upon r(t) in 
order to guarantee that each as t-K). 


THEOREM 4.2 [ CARROLL ]: Suppose there exists no set of real constants 

{q •}< i - 0 t 2, , . . , n i- m for which the command input r(t) of the 

1 , 
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observable and controllable system in its steady-state condition is a 
solution of the homogeneous differential equation 

n+m ji 

- 4 i ' 
i=0 1 dt l 


l «i Ti r - * 


where n and m are defined in (IV. 5). Then lim $.(t) = O t 

* 1 

i = Oy lj ...j n + Wj and lim eft) = 0 is assured. 

PROOF: It has been shown that 

lim e (t) = 0 
t-*» 1 


lim u.(t) = 0 for each j 




3 


lim if).(t) = constant for each i. 
t-*=° 1 


( IV. 18) 


Therefore, from (IV. 8) and (IV. 8A) 


lim a.(t) = constant for each i 
t-*» 1 


lim B.(t) = constant for each i 

t-H» 1 


(IV. 19) 


Referring to n equations (IV. 4), each equation may be differentiated 
in a manner so as to form the vector e (t) = [e./ n \ el n 

S J. jlpO 

t t 

, e 3 . Employing (IV. 18) and (IV. 19) in determining lim e (t) and 

t-*=° s 

letting 8.. = 0 for i > m, (IV. 20) results. 


0 = e*"” 1 * + a + 8 r (n_1) 

2 n-r n-1 

(n+l-i) _ (n-i) (n-i) + a Jn-i) 

! i - e i.l + Vi y + Vl r 


, i = 2 ,3,4 . .n - 1 


e n * V + V* 


(IV-20) 


All e's may be easily eliminated from (IV. 20), yielding 
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n-1 . 111 i 

0 =( V a.sjy + ( y 0.s )r. 
i=0 1 i=0 

Let the stable (but unknown) plant transfer function be 

n m . 

( I a.s )y = ( l b.s )r, a = 1. 

1=0 1 i=0 

Combining (IV. 21) and (IV. 22) yields 

[ • n-1 . m . nj i ? i 1 

( ][ a.s 1 ) ( b.s ) + ( I ) ( I a i s M r ’ 

i=0 1 i=0 1 i=0 1 i=0 -I 


(IV. 21) 


(IV. 22) 


( IV. 23) 


Equation (IV. 23) represents a condition upon r(t) which is assured in 
the limit by (IV. 18) and (IV. 19), that is to say, after adaptation 
has forced e^ to vanish. Two distinct possibilities exist regarding 
the solution of the (n + m)th-order linear homogeneous differential 
equation (IV. 23): a) either the steady-state system command input r(t) 
obeys (IV. 2 3) for sorre values ou and 0^, or b) the n + m + 1 coeffi- 
cients of polynomial in brackets are in the limit each zero. By 
supposition of the theorem, a) cannot occur; consequently b) must be 

true. 

Using the assumption of observability and controllability to 
insure that (IV. 22) is relatively prime, it is easy to show by mathe- 
matical induction that condition b) implies that the constants cu and 0. 
are each zero, which was to be proved. 

COROLLARY: If the steady-state command input r(t) is periodic , a 

sufficient condition in order for lim eft) - 0 in (IV. 4) is that r(t) 

i-xo 

contain at least [n + m *11/2 distinct frequencies in its steady-state 
condition. 

It is emphasized that r is the command input to the system and not 
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necessarily a special identification signal. If the steady-state 
r is periodic, then it must possess the required number of frequencies. 
However, an r which is steady-state aperiodic must meet no restrictions 
to satisfy Theorem 2. 

Reconstruction of T 

Using the "nominal" matrix A^ as initial condition, the actual 
value of the system parameters may be determined by integrating the 
change in parameters {f^}, defined in (IV. 17), until adaptation is 
complete, and combining appropriately in the form of the matrix T. Thus 
T(t) "drifts" toward T as adaptation progresses and lim T(t) = T. The 
example makes this technique clear. 

A 

w, the estimate of w, is constructed from the observer output z 

A A 

by forming T(t)z. Consequently, lim w = w. 

t-KB 


Example 

A third-order plant with one zero is considered for illustration. 
Let the plant be described by 


— 1 
o 

H* 

0 



o 

1 

0 0 

1 


w + 

C 1 

_- (a o + V ~ (a l + a l } 

-u 2 1 

V 


O 

o 

1 


y = « 1 (IV. 2*) 


in which a Q , a^, a^t and c^ are unknown. a Q , a^, a 2 are the 
nominal values. In output form, (IV, 1*) is 


~(a 2 + a 2 > 1 0 


0 

-(a^ + a^) 0 1 

X + 

b i - b i 

_- (a o + V 0 


_ b o - B o_ 


(IV. 2 A*) 
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The error equation (XV. 4) is now 


-k 2 1 0 a 2 0 0 

-k^ 0 1 e + a 1 y + ^ r+ ^ 

- k o 0 0 “o 8 o “o 


(IV-4*) 


and the scalar equation (IV. 6) is now 

«! + k 2 “l + Vl + k 0 e l " % + “l * V X 1 

+ (a 1 + + 8-jT + (0 Q + ^Jr + u Q , 


The scalar error equation (IV. 6*) is equivalent to 


(p + Aj^Hp 2 + a x p + aQ^ = (p 2 + a-jP + a Q ) ( ^ 

1 1 1-j ,j / • \ . 

+ **i - l l l a i+j + i — j * k 3 + V 

1 k=0 i=0 i=0 1+1+1 dt 1 K K 


(IV. 6*) 


4 1 1-1 J n\ 

-III a. * + u + u . 

k=3 j=0 i=0 1+1+1 dt 1 K * 1 U 


(IV. 7*) 


It is seen from the right side of (IV. 7*) that and v^ must be 
generated in order to allow removal by u^ and u^. v^ » which is defined 
in (IV. 8), may be generated by state-space means. 

To illustrate generation of v^, the following notation is adopted: 

V 1 ' • \ 


v (2) = -s_ V 
K dt k 


v k (i) = “i V 

k dt i * 
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Then the generation of and defined by 


v i + a i v i + Vi * x i 


results in 


Vjd)' 

_ 

' 0 l” 


\(v 


' 1’ 

V 2) _ 


; a o " a i 


/*N * 

CM 


; a i 


Thus both v and v^ are available measurements without the benefit of 
differentiation of v^ or x^. Other may be generated similarly. 
Using this notation, the implementation of inputs as 

U 0 = W 2) + a i V 0 (1 ^ + *l (v l (2) + a l V l (1 ^ 

+ 4> 3 (v 3 (2) + a^Cl)) + <|» 4 (v 4 (2) + a^d)) 

U 1 = ^ 0 V 0 (1) + Vl (l) + *4 V 4 (l) + *3 V 3 (1) 
reduces (IV. 7*) to 


2 2 r 

(P + ^Xp + a x p + a Q )e ;L = (p + a^p + a Q ) ( l 4^) 
Defining i as in (IV. 17), the observer has the form 


1 

i 

x 

ro 

H* 


g 2 


o 
l 


' o “ 

-k x 0 1 

Z + 

g l 

y + 

b i 

v + 

u i 

_-k Q 0 0_ 


. g 0_ 


1 

tr 




where 


■s 

b l = ' m 4 ®1 V 4 


. m 

b n = — e.v 

0 m 3 1 3 


(IV. 12*) 
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w is the estimate of plant state w, and lim w = w. 

Note that CT=C. 

A. Simulation 

The third-order system of the example was simulated on a digital 

computer using the following parameters! 

a Q = 24 Oq = 0 = 30 k Q = 24 ro g/™3 = 8000 

a. - 26 a = 74 c. = 195 k, = 26 = 2000 

X X Z X U O 

a 2 " 9 ci 2 9 0 b^ = 30 k 2 = 9 g Q = g 2 = 0 

The eigenvalues of the observer (determined by {k^})were X^ = -4, 

X = -2, X = -3. The input to the plant was a square wave of magnitude 
z o •) * 

1 and frequency €%> Two parameters, b Q and were adjusted by the 
adaptive law. These were initially set at bg - 73, = -5 corres- 
ponding to a correct value of bg - 75 , = -74. Figure 4.2 


illustrates the behavior of b Q , g^, e 2 and as a function of time. 
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It is noted that the behavior is somewhat slow and oscillatory . 

Remark 

A A A 

As has been previously stated, w and Tz and lim w = w. In the 
general case of an artibrary plant matrix A, the determinant of T may 
vanish for some instances of time. These momentary occurrences 9 of 

A A 

course, have no detrimental effect on w since convergence of w to w is 

A 

guaranteed 4 It need not be feared, either, that the elements of T 
may become impossibly large at any time during operation, since the 
elements of T are guaranteed by the Lyapunov function (IV. 15) and 
(IV. 16) to be stable in the sense of Lyapunov and therefore bounded. 

The following theorem summarizes the results of this section. 
THEOREM 4.3 [ CARROLL ] A full-order adaptive observer (IV. 3A) can be 
constructed to observe the state of and to identify the parameters 
of system (IV. 2) having unknown parameters in matrices A and B iff 
(AjC) is a completely observable pair and if the command input r is 
periodic , possesses more steady state frequencies than half the number 
of parameters being adapted. 

The adaptation is accomplished by algorithm (IV.17) 3 dependent 
upon definitions (IV. 9) or (IV.9A) 3 when the control u is implemented 
according to (IV. 7) subject to definitions (IV. 8), (IV.8A) 3 (IV.10) 3 
(IV. 11) J (IV. 1U). 
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4.3 An Alternate Adaptive Algorithm for the Observer 

In Section 4.2 the single-output adaptive observer was synthesized. 
The adaptive algorithm depends upon the filtered-output and filtered- 
input variables v^ , defined in eqs. (IV. 8) and (IV. 8A). The transfer 


function of these filters is 

» 

1 


^ ~l xi 2 

s +a 0 s +...a,s+a n 
n-2 1 0 


(IV. 24) 


for i=0, 1, 2, ...» n-2. This configuration apparently allows effective 
noise suppression since high frequency signals contained in the input 
of the filters are attenuated. 

However, according to (IV. 9) and (IV. 17), the adaptive laws for 


ou and 8^ are given by 
m m 

<t. = - ( — v. + — a.x-)e. 

l m. l m , l 1 1 

x n-1 


0 , 1 , . . . , n -2 


m m 

s s 

8. = - (■ — v. + — a. r)e. i = n, n+1, .... 2n-2 

i-n ■ rn. x m„ . l-n 1 * 

i 2n - 1 

except for i = n-1 and i = 2n-l, and for which it is assumed that 

a p . /0 . Therefore for the case in which a .^0,8 , the 

n-1 n-1 n-i n-i 

adaptive algorithm depends upon the combination of and or r. 

The resulting transfer function is 3 for the first of the above equations. 


m 


m ♦ 
i 


n-1 n-2 

s +a n s +. . .+a_ s+a n 
n-2 1 U 


m 

s 

— a. 
m . x 
n-1 


which equals 


m , 

s ( n-1, 

— a. (s 
rn , l n-2 

n-1 


„ m 

n-2 \ s i 

; + ■ . . +a. rt )+ — s 

0 m. 

1 


n-1 


+ a 


n-2 


n-2" 


'+*..+ as + a^ 


(IV. 25) 
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A similar expression is obtainable for the second of the adaptive 
equations. 

From the appearance of (IV. 25), it seems doubtful that the result- 
ing filter offers much noise suppression in the adaptive law for the 

case where a ,^0, 8 , 5 * 0 . 

n-1 ’ n-1 

In this section the adaptive algorithm is altered so that it 
depends directly upon filters having transfer functions of the form of 
(IV. 24), thus enhancing the noise suppression capability. In addition, 
the filter poles in the alternate algorithm may be chosen distinct from 
the observer eigenvalues if desired, and the Gilbert and Monopoli adaptive 
law ([46]; also refer to the section Degree of Stability in Chapter 
III) my he implemented in order to improve the speed of response of 
the adaptive algorithm. 

Development of the Algorithm 

The new algorithm is based upon the same form of the observer 
as the form of the observer in Section 4.2 with the exception that, 
in eqs. (IV. 5), the matrix H is defined as 

H = diag [h^ , h 2 , ..., h^] andnxn; 

that is to say, h^ is here non-zero. Consequently the discussion of 
the transformation and the error equation is the same as in Section 
4.2. The new algorithm is therefore developed from the starting 
point of the error equation (IV. 4) 

e ~ K Q e + (GC - AA Q )x + AB + Hu (IV. 4) 


in which 
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GC-AAq = 


(IV. 26) 


AB = Cif» 1 , i > 2 , . • • , ip n ] 


The vector error equation (IV. 4) is collapsed (in the same 
manner as (IV. 6)) to yield 

r . <i> _ r f (n-k) "'r' 1 j (n-k-j-l)H 

E k i e i - E [Vi * E p ( V >J 

1=0 k=l L 3=0 - 1 


c=i i=o - 1 


+ y h. u. 

j=l ] 3 


(n-j) 


(IV. 27) 


in which p-* = 4-s and in v/hich it is to be understood that the second 
r dt J 


summation is to be ignored when n-k-1 < 0. 
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The intent at this point is to define the vector v in such a 
manner so as to make the right side of (IV. 27) equal 


r n-1 r n ~1 £ 

I c.p l (^v. + il^s.) + I h.w. 

i=0 1 J L i=l 11 J j=2 1 1 


(IV.28) 


where v. and s. are filtered-output and filtered- input variables with 
ii 

transfer functions similar to (IV. 24). w is a vector to be defined 


later. 


The function v^ and s i are accordingly defined as 


T =.v' 3) ■ x!"- 1 ' 

. n T 1 1 

j=0 J 


"j 1 . r'-” 

j=0 ^ 


( IV. 29) 


i “ 1 ? 2 ) 3 , • » • $ n 


and c _ = 1. 
n-1 


It is pointed out tha the 2n equations (IV, 28) actually represent two 
low-pass filters of order n-1 each. This follows from the transfer 


function. 


n-i 

s 

* s n 1 + c „s n + ... + c, s + c n 

n-2 1 0 


n-i 
s r 

g a ~ . — , , . — » 

1 s n 1 + c 0 s n + ... + c.s + c A 
n-2 1 u 


l — 1 ) 2j 3 } • • • j n 


from which it is seen that 


(IV.29A) 


v. = v. 
l l-l 


s . - s, . 

t 1-1 


(IV. 30) 
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From the identity that 


p 1 (*v) = f pi <■ 

j=0 


it follows that (IV. 28) equals 


\ x ji c i y 0 pi <■ * v£° ] "X w 


I Y c. pf pi (^i-i- 1 ’) + vY] ♦ ! c oVk * l h *<»-!> 

=1 i=! 1 Lj=0 k k K k j k=1 0 k k j=2 1 D 


This expression is set equal to the right side of (IV. 27) and the vector 
u is subsequently determined. After employing (IV. 29), the resulting 
expression is 

I V "' ]) - l Vj 3> f I l P < I c i Vk 3 > 

j-1 3 3 j=2 ^ ^ k=l j=n-k i=]+l 

- I l P^C*! - I V k ’ 

k=l j=0 K X i= j+1 

n n-2 .n-1 


+ 1 i p ] d c i Vk 3 ~ 1)) 

k=l j=n-k i=j+l K 


n-1 

-I 


k-l 


n r ^ j r'i t (n-k-j-1) n r^ (i-j-1).-. 

I P J [\(r J - l c s J )] 

j=0 k i=j+l 1 k 


for which it is understood that a summation term is to be ignored 
if the upper index is less than the lower index, and that n >_ 2 . This 
expression is simplified by use of (IV.29A) and (IV. 30) so that 
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n-1 


j=0 


,(j) - 


n-2 

l 

h . 

»<P 

j=0 

n-] 

n-] 

n 

n-2 

. n-1 


+ 1 l l c i Vk-i+i+l 5 

k=2 j=n-k i=j+l 1 K k 1+3+1 


n-1 n-k-1 . . j 

'I I I c 4_i 

k=l j=0 K i=0 31 


Viti J 


n n-2 . n-1 

+ L J, pl 'L c il\W 


k=2 j=n-k i= j+1 


n-1 n-k-l . j 

‘I l t Vi+x 5 

k=l j=0 k i=0 3 1 k+1+1 


From the above, the vector u can easily be determined by equating terms 
containing equal values of j on both sides. The result is 


n-1 


h u = h w - c n [ Y ( 4>. v, . + i. s, , ) 3 
n n n n 0 . L . r k k+1 *k k+1 J 

k=l 


n n-1 


h . u . = y y c.(d», v, . + i s, . . , ) 

1 1 -Z ■ i k k-i+n-]+l v k k-i+n-j+l 


k=j i=n-j+l 


j-l . . n-j 

‘Jl Jo Vj-i Vi + 1 * *kj 0 Vj-i Vi.l 1 + h j”j 


(IV. 31) 


for j = 1,2, ...» n-1. It is understood in (IV. 31) that summation 
terms are to be ignored if the upper index is less than the lower 
index. The function will be defined later. 

Ey employing (IV. 31), the collapsed error equation (IV. 27) 


becomes 
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Jo k i e “ > = £ Cipl> C jl UkVk + ' kSk ” + jo h "-5 V "-^ 


k = 1 , C = 1 
n * n 


(IV. 32) 


The Laplace transform of (IV. 32) is taken and both sides of the 

n-1 £ 

equation is divided by £ c.s yielding 


i=0 


£ n n 

n-l . e l = <£ C J, ( Vk + 

r 1 k-1 

l c.s 
i=0 

n-2 . 

+ y h . S- 1 w . 

i=0 n ’? . n ' 3 

n-1 . 

I c.s 1 
i=0 1 


f(s) 

n-1 . 

I c.s 1 

i=0 


(IV. 33) 


for which f(s) depends upon the initial conditions of the variables 
in (IV. 32). On the left side of (IV. 33) is the ratio of polynomials 
n 


V k.s 1 

1=0 1 — = s + k n - c 0 + 1=0 


n-2 

l Pi ® 1 


n-1 . 

I c.s 1 
i=0 


n-1 n-2 n-1 

l c.s 1 
i=0 


(IV. 34) 


where 


P„ = k A - c rt (k_ n - c_ „) 


0 0 ^0 V n-1 n-2' 

p . = k. - c. ,-c.(k - c - ) 1 = 1,2,..., n-2 

1 i l-l i n-1 n-2 
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Defining 


h , w . = p, e. j = Oj lt2> •••» n “2 

n-] 3 j * 

then (IV. 33) becomes 


(s + Vl - c n-2 )e l = C 


n sp 

i 

k*l 


k v k * Vk )] + 


f(s) 


n-1 . 

I c.s 1 
i=0 


(IV. 35) 


In the time domain (IV. 35) is 

n 

"l + (k n-l ' C n-2 )e l = J. ( Vk + Vk> (IV-36) 

n-l 

+ l X exp C-A.t] 
i=l i 1 

Here x- is a bounded function dependent upon the unknown initial 
condition of the equation (IV. 27). Eq. (IV. 36) is equivalent to 
(IV. 27) and to (IV. 4) with the exception that (IV. 36) is a scalar 
equation in terms of e . A Liapunov function candidate can be 
constructed so that it depends upon but not the other elements 
of the vector error e. This function will be chosen according to 
[46^so as to allow a faster rate of convergence of the resulting 


adaptive law. 
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v * i •! * j, ( *i * ViV* * Ji it: ’ ViSi) 

The time derivative of V along the trajectory described by (IV. 36) is 


Define 


V = - (k 


„-l - c n-2 )e l + J x U k V k * Vk )9 l 


* j “m7 <*i + Vi*l )(i i + q i V i e l > 


i=l i 


l (+i + Vi e i )( ii + q i s i e i ) 


i- 1 m„ 

l 


n-1 


+ e 


1 - 1 , X i 
A 1=1 


expC-l^t] 


Then 


= " m i v i e l " q i V i e l 


*i = - m i s i 6 l ' q i S i 6 l 


(IV. 37) 


m. > 0, m. > 0, q. >_ 0, q. _> 0 i = 1, 2, , n 

1 1 i A 


- ‘Vl - V 2 )e i - & ( ’iVl + * J, X i 


n-1 


V = 


i-^t] 
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If the set of constants {c.} are chosen so that the filter poles 

all have negative real parts and if " c n-2 * °* then X i P i 

vanishes exponentially and V is then negative semidefinite on the 
compact manifold (e, f) hut negative definite on the non-compact 
manifold over which V is defined. Consequently, e ± - 0. 

The expansion to the noncompact manifold - i.e. require e, •,** - 
has been discussed in Sectic 4.2. The results obtained there, in terns 
of a steady-state frequency requirement for the input signal r, applies 
equally here. The reader is referred to Section 4.2 for a discussion 

of this. 

The adaptive equations (IV. 37) appear to require the generation 
of a derivative for implementation whenever either q £ or q £ is positive. 
Of course, in the actual adaptation of * and no derivative is 

required. Since <(k - g*_ v i i i 1 

constant, (IV. 37) defines 


8i = - m i V i 6 1 ' 

q. v. e 
H i 1 1 

(IV.37A) 

K = - s i e i ' 

• 

\ vi 


the same 

, » 


Ei = - % v i e l ‘ 

»i J v i e i dt 
0 

(IV.37B) 


! t 


d . = . ,i £7^ - 

h 1 s i e i dt 



I„ (] V. 37B) it is seen that the parameter estimates 8- and d. for each 
i am available without recourse to differentiation. 

However, implementation of (IV. 31) seems to require the availability 
or i and , which am dependent upon a differentiation network if q £ 
or q. is positive. Nevertheless, the differentiation can be avoided 
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by careful manipulation of the u^ terms in (IV, 31), The basic 
notion here is, whenever and appear in a u^ term, to place 
the derivative part of <(>^ and IJk in u j_^ without implementing a 
derivative network. The relocation of the derivative part of 
or <Jk in a different u implicitely generates the differentiation. 
This operation is accomplished by use of the identity 

v 2 * 37 <ev l’ , 2 ) ’ ev l' r 2 

The results are found to be 
n 

h u “ T c n (rrL v. - q, v, )v, e. + h w 
n n . O k k+1 n k k k 1 n n 
k-1 


*J, c o ( \ Vi - «k V s k e l 

k=l 


n n-1 


’i U j °i e l ’k (q k Vi«-j- \ Vi+n-^l’ 

J J k =3 i=n-]+l 


j-1 n-j 

*1 ^ V l (y c j_. V - c . v k+ .) 

k=l i=0 J 


n-i+1 


q k e l V k 


> c . . . v. .... 
. L n n-n-i-1 k+i+1 


n n~l 

- I . 1. =i % »i \ v k-l+n-j-l 

k=l +3 i=n-;j 


n n-1 


h 1 1 c i e l S k ^ q k S k-i+n-j ^k s k-i+n-j+l^ 

k=] i=n- ]+l 


j" 1 n :3 ~ 

*1 *1 s ki„ <*k Vj-i Vitl ' \ C n-j-i Vi’ 

K — _L X — U 
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A 


q k e 


, ■;;! 


r 

i=0 


C n- j-i-1 S k+i+l 


n n-1 

- I l 

k= j+1 i=n- j 


c. 

1 


<*k 


e 


1 


S« • • « 

k-i+n-]-! 


+ h .w. 

1 D 


(IV. 38) 


h iV 


n 

- 1 
k=2 


VlVk-1 ' Wl 


n 


i=0 


C n-i-2 v 2+i 


n n 

"k~2 ^ 61 Sk Sk “ 1 " ^ 6l Sl i=0 S2+i 


For reference with the use of the above, 
repeated 


the definitions of w . are 

3 


h . w . = p . e, 
n-i n-i i 1 

°0 = k 0 - c 0 (k n -l - c n-2> 

p i = k i ‘ c i-l - °i (k r»*l - c n-2 > 
i = 0, 1, 2, ...» n-2 


(IV. 34) 


It is noted that u has the desirable property that lim u = 0. 

To summarize, the theorem 4.4 is given. 

Theorem 4. 4 [CARROLL] 

A full-order adaptive observer (IV. 3A) can be constructed to 
observe the state of and to identify the parameters of system (IV. 2) 
having unknown parameters in matrices A and B iff (A, C) is a completely 
observable pair and, if the command input r is periodic , r possesses 
more steady state frequencies than half the number of parameters 
being addicted. 

The adaptation is accomplished by the algorithm (IV.S7H) dependent 
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upon low-pass filtration of the system input and output . The filters 
are given by (IV. 29) or (IV.29A) and the poles of these filters may 
be freely chosen independently of the observer eigenvalues whenever 

a> k n-l - V2 =• 0 

b) the filter poles are chosen so that all He in 
left half plane > and 

c) the control input u is constructed according to 
(IV. 38) and (IV. 34) 

Example 

The system of Section 4.2 is used her*e as on example of the 
altered adaptive law. Let the system be as (IV.l*) and the error 


equation is 


4 1 


-k 2 1 0 


e i~ 


♦l 


0 " 


u i 

*2 

= 

-k 0 1 


e 2 

+ 

^2 

X l + 

^2 

r + 

U 2 

*» 


; k o 0 °j 


e 3^ 


*3 


*3 


_ U 3 


where 

■+! = % + a 2 *2 = d 2 + 0 1 

= g 2 + °1 ^3 = d 3 + 0 3 

^3 = g 3 + “O' 

The collapsed error equation is 

"e 1 + k^ + k 1 e 1 + k Q e 1 = p^^) + p(^x) + 

+ p(ij» 2 r) t (ip 3 r) + u x + u 2 + u 3 
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The filters are given by 


2 2 
(p + Cjp + c Q )v 1 = p x x 

2 

(p + CjP + c Q )v 2 = px 1 
(p 2 + c lP + c 0 )v 3 - X x 


2 2 
(p + C X P + c Q )s 1 = P r 

(p 2 + c lP + c Q )s 2 = pr 

(p 2 + c^p + c 0 )s 3 = r 


which may be generated by 


0 


1 

-c. 


" c o ' c i 


V 1 = " C 1 V 2 “ C 0 V 3 + X 1 


S 1 = ‘ C 1 S 2 “ C 0 S 3 + X 1 


0 

1 

0 

1 


The input vector u is given by 

• • p 

U 2 = " C 0 ( *1 V 2 + *2 V 3 + '^2 S 3 ) + Ck l ~ C 0 ~ C 1 ( V C l )]e l 

u 3 = 4 1 (c 1 v 2 + c Q v 3 ) + i 2 c 2 v 2 + c 2 ^ 3 v 3 
+ c 2 ^s 2 + c 2 i 3 s 3 + Ck Q -c Q (k 2 -c 1 )> 1 
According to (IV. 37B) the adaptive laws are 

h '■ -’iYi - *i i Vi dT 


e, * -i 2 Vi - ”2 1 0 v 2 e i dt 


% = Va'i ' m 3 




V 3 e l dT 


0 
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d 2 * - Vl'l ‘ m 2 \ s 2 e l dT 

0 

d 3 = - q 3 s 3 e l • ”3 f s 3 e l dT 

0 

With this definition, v becomes 

u 2 = ( -V 2 C l + Vl C l ~ C 0 m i V 3 + q l C oV e l V l 

+ (-rn 2 s 2 + ^2 S l )c 2 e l S 2 + (_m 2 V 2 + q 2 V l )c 2 e l V 2 
+ (m 3 s 3 + q 3 s 2 )c 2 e lS3 + (-iHgVg + q 3 V c 2 e l V 3 

q WlVs + C oVlV2 + °0l2 e l V 2 V 3 * Ck r C 0- O l (k 2-°l >:)e l 
u 3 = - Vl V l ( Vl ‘ "lV " c O e l v 2 (q 2 v 2 ' ”2 V 3 ) 

’ C 0 G l S 2 (q 2 S 2 ‘ " , 2 S 3 ) * Ck 0 " C 0 (k 2 “ 

U 1 = - q l e l V l <C 1 V 2 * C oV - C 2 e l (q 2 V 2 + q 3 V 3 ) 

-=2 e l (q 2 s 2 + q 3 S 3 ) 

The poies of the filters may be arbitrarily placed so long as 

k 2 - °i > °. 

The observer configuration and transformation reconstruction is the 


same as in Section 4.2. 



CHAPTER V 


SUBSEQUENT EXTENSIONS OF THE SINGLE-INPUT 
SINGLE-OUTPUT ADAPTIVE OBSERVER - PART II 


5.1 New Canonical Form 

Subsequent to the published appearance of the single -input single- 
output adaptive observer in [71], and earlier in a different context in 
[44], interest was generated among other researchers in the adaptive 
observer concept. This chapter examines the published effort of those 
researchers particularly in comparison with the adaptive observer of 
Chapter IV. 

The first modification of the adaptive observer was by Luders and 

Narendra [62]. They proposed a transformation of the system that is to be 

observed into a different canonical form than the output form of 

Chapter IV in order to lower the order of the state variable filters. 

Whereas, with the output-form observer, the filters are of the form 

♦ 

X 


- a. + 
i 


n-1 u 
s + 


n-2 

a _ s + 
n-1 


a i s 


+ 


0 < i _< n-2 , 


in which n is the order of the system, the new canonical form allows the 
state variable filter to be of the form 


— — r- , 0 < i < n - 1 

x 

In order to compare the two schemes it is supposed that n parameters in 
each of the input and system matrices of the system are to be adapted. 

Then by Ihe method of Chapter IV there are required 2n-4 integrators to 
implement the filters whereas the system in the new canonical form 
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requires 2n-2 , certainly not an improvement! However,, if the number 
of parameters being adapted is q, the method of Chap-er IV requires 

"t 

2n-4 integration to implement the filters as compared to q-2 integrators ~ 
for the method with the other canonical form. Thus with the second 
form there is a significant savings when the number of parameters being 
adapted is small. But there is a penalty for this savings; the eigen- 
values of the observer (which are the same as the roots of the denominator 
polynomial of the state variable filters) must be both real and distinct 
with the canonical form of Luders and Narendra where there is no such 
restirction in the output form representation. 

The canonical form proposed by [62] is 


(V.l) 

nxn 

where A is a square diagonal matrix of order n-1 having arbitrary but 
real and distinct eigenvalues. A system (IV. 2) may be transformed so 
that the system matrix A is in the form (V.l) iff the system is completely 
observable through its single output [62]. The elements ou of (V.l) 


a 


n-1 


n-2 


n-3 
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represent the unknown parameters of the system. 

It is noted that the unknown parameters of the system appear in the 
left-most column of the transformed matrix in both the output form and 
the form (V.l); this 13 a necessary requirement for any canonical form 
used in an adaptive observer when the system output matrix is [C 0 0.>.0~\ y 
C ^ 0. The reason for the necessity is that the unknown parameters must 
appear in the range space of the available measurements, so that the 
parameters may be adapted by an algorithm dependent only upon available 
measurements. That is to say, the unknown parameters must appear in(|j!C T ] 
where C is the output matrix of a system (IV. 2) and the symbol & denotes 
"the range of". 

The observer of [62] is, analogous to (IV. 3A) , of the form 


z = Kz + GCx + Dr + Hu (V.2) 

in which x is the state of the transformed system (that is, transformed 
so that the system matrix A of (IV.2A) is in the canonical form (V.l)) 
and K has the form 


-\ 1 1 1 1 ... 1 
0 
0 


(V.3) 


Then D and G are adjusted in (V.2) to make the error equation (IV. 4) 
asymptotically stable in the sense of Liapunov. The control u is synthesized 


to enable this to be done. 
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It is apparent that the approach in [62] is very like that of the 
last chapter but with the exception that a new canonical form is used. 

The new canonical form allows, however, one difference in the develop- 
ment of Chapter IV. In the technique of Chapter IV, the vector error 
equation (IV. 3) is first converted to a scalar differential equation 
(IV. 6) and then integrated to a first-order differential equation (IV. 14) 
by use of the filtered state variables. The canonical form of [62] 
allows the sequence of these steps to be reversed. By doing this the 
awkward expressions in (IV. 10) and(IV.ll) are avoided. For a detailed 
account of the procedure of [62], the reader is referred to the ’’adaptive 
law 11 section of Chapter VI. 

The same researchers have proposed yet another canonical form [63], 
albeit a generalization of their form (V.l). This form is 



where is a row vector of dimension 1 x (n-1) and F is a(known) square 
matrix of dimension (n-l)x(n-l). A requirement is that the pair (q ,F) 
be completely observable. (V.l) is seen to be a special case of (V.4). 

The advantage of (V.4) over (V.l) is that n-1 of the observer eigen- 
values, which are the eigenvalues of F, need not be both real and dis- 
tinct as required by the form (V.l). The oorre spending disadvantage is 
that, when F is not diagonal, the resulting state variable filter in- 
evitably requires more integrators for implementation, which puts the 
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adaptive observer based upon (V.4) at a greater disadvantage over the 
output form observer when the parameters that are to be adapted are 
many, and lessens its advantage for few parameters. 

Nevertheless, this author believes that the form (V.4) is a signi- 

T 

ficant contribution because of the requirement that (q ,F) need be com- 
pletely observable, as opposed to the need, in (V.l), that q projects onto 
each axis of £ n . As yet there has been no verification of the possi- 
bility that significant simplification of the observer structure can be 

T 

accomplished by judiciously choosing F and q » 

One final point should be made in comparing the form (V.4) or (V.l) 
with the output form of Chapter IV for developing adaptive observers. 

That is the fact that, despite the existence theorems for transformations 
to the diverse canonical forms, one must have available a literc il trans- 
formation matrix in order to implement the retrans formation of the 
observer output. In the output form, since the literal transformation 
from companion form to output form is easily produced for any order 
system, and since the van der Monde matrix couples the Jordan form to 
the companion form, the problem of obtaining a literal transformation 
matrix is simplified to the problem of finding a literal expression 
fo r* the eigenvalues of the system. Although this is a difficult chore, 
it is perhaps a less difficult task than seeking for a literal transformation 
directly from the equation A = T~ 1 AT as must be done with the other forms 
that have been suggested. 

5.2 Greater Filter Freedom 

In the adaptive observer of Chapter IV and the diverse forms of 
sect ion the poles of the state variable filters must be the same 

as the eigenvalues of the observer. Since the system in which the 
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observer is to be used may contain noise, the requirement that the 
filter poles be equal to the corresponding Observer eigenvalues might 
not allow so effective an adaptation as could be obtained if the eigen- 
values of the observer and the poles of the filters could be independently 
chosen. 

Kudva and Narendra have proposed [64] an observer of the same form 
as that in Chapter IV, i. e. having the observer matrix in output form, 
and have shown that the poles of the filters may be independently 
chosen from that of the observer eigenvalues. 

This observation is proved by use of the Kalman -Yakubovich lemma 
[48]. This lemma says that if 

1) the square matrix K is a stable matrix, 
and if 

2) h T (sI-K)""^d is positive real, 
where h and d are vectors, 

then there exists a positive definite square matrix P and a vector q 
such that 

T T 

K P + PK = - qq 

and 

Pd = h. 

The development of the proof, thct the poles of the filters can be 
freely chosen, picks up essentially at equation (IV. 12). This scalar 
equation is then re-converted to a vector equation of the form 

e = Ke + d $^v (V.5) 

where = 3°^ $ is the vector composed of the parameter differences 

r T 

a j_ Si » $ *-<*0 a -^ *•• a n ®o^l ***^m^ * d is a vector with first 
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element unity. The Liapunov candidate is now chosen as 

V = i {e T Pc + (V.6) 

where P and r are both positive definite and T. is diagonal. The 
differential of (V.6) along the trajectory described by (V.5) is 


• ITT „ T T T ' 

V = i e (K P + PK)e + e Pd 4> v + $ T4 

Therefore choosing 

• -I T 

$ = -r e Pdv, 


(V.7) 


( V. 8) 


(V.7) becomes 

V = j e T (K T P + PK)e (V.9) 

By applying the Kalman-Yakubovich lemma the adaptive law is reduced to 

4> = -r'-^v (V.10) 

since = e^. Equation (V.10) is similar to (IV. 17). 

The poles of the state variable filters are determined by d in the 
sense that each has the form 


N. 

i 


n-i 

s 

n-1 n-2 , n-3 

s + d^s + dgS + 


+ d 


n 


On the other hand, the eigenvalues of the observer are the eigenvalues of 
the matrix K in (V.5), which is in output form. Thus the poles of the 
filters and the eigenvalues of the observer are independently chosen. 


5.3 Cyclic Multivariable Adaptive Observer 

One may recognize the distinction between adapting (and identifying) 
parameters in the system matrix A of a system (IV. 2) and adapting (and 
identifying) parameters in the input matrix B by means of the adaptive 
observer. That is to say, the adapting of parameters in the system matrix 
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A is accomplished by entirely depending upon a transformation T to place 
A in a canonical form, while adapting parameters of the input matrix B is 
accomplished by adapting parameters of T _1 B without regard to which T, 
dependent only upon A and the chosen canonical form, has been chosen. 

This being so, the single-input single-output adaptive observer can 
readily be extended to a multi-input system (because no change is required 
in selecting a T which delivers A into canonical form). 

Luders and Narendra reported [65] just such an extension based upon 
their previously reported single-input single-output adaptive observer 
[62] (see section 5.1). In addition they noted that if the system has 
multiple outputs and if it is possible to combine these outputs in a 
manner so that the system is completely observable by this single com- 
bined measurement, then the single-output multiple -input observer can 
serve as a multivariable observer. 

Not all multivariable systems can be observed through a single 
output even though it is completely observable through multiple outputs. 

In this, the system matrix A plays a crucial role [66]. Let 0 4 b e ^. n 
and let range be denoted by the symbol^. Then the space is called 
the cyclic subspace generated by b when 
g b = [A:(^(b)] 

where [A: (j^_ (b) ]= C3^(b) + A0^_(b) + A (J(_(b) + ... + A (J^(b). 

The space £ n is cyclic if there exists a b e £ n such that = ^, n . 

It is common usuage to say that A is cyclic in order to imply that 
is cyclic. 

A matrix A need not be cyclic. A trivial example is 

, b = [b b b 2 ] T 4 0 
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Then £ b = (£<b) 4 g, 2 . 

From the preceeding discussion, it is apparent that the multivariable 
system of [65] is limited to cyclic systems. 

One interesting observation made in [65] is the following. Suppose 
that the system (IV. 2) can be obtained, by transformation if necessary, 
so that the uppermost row of the output matrix C is of the form [1 0 0 ... 0], 

suppose that there are unknown elements in the remainder of C, and finally 
suppose that the system is observable through the first output y^ (i.e. 
the pair [1 0 0 ... 0] and A are completely observable). Since the 

state of the system can be determined through the single output y^, the 
unknown elements of C may be determined, and this may be done adaptively. 


Choosing 


then 


V = tr [(AC) (AC)] 

V = -tr [(AC) T e y z T ] 

T 

= - e e + e he 

y y y 1 1 


(v.u) 


where AC is the difference between the estimate of the output matrix 

and the true value and e^ equals the error between the observer estimate 

» 

of the output and the output itself. Since -*■ 0 in (V.ll), V is 
negative semi- de finite . H ope fully *th is implies that AC-+0, thereby 

estimating the unknown values of C. 

It is apparent that the cyclic multivariable observer [65] is of 
n 1 order and the output measurements are therefore generated even 
though they are available for measurement. The next chapter describes 
a reduced adaptive observer which generates the state of the system by 

an observer of order dependent upon the number of output measurements. 

• 

A 1 Note that V in (V.ll) is only semide finite on the space of V. 



CHAPTER VI 


THE REDUCED ADAPTIVE OBSERVER 

6 . 2 Comparison with Cyclic Adaptive Observer 

The adaptive observer concept is a scheme for determining the 
state of a system possessing unknown parameters when only the system 
input, output, and form are known. The first reported adaptive 
observer, for single-input single-output time invariant linear systems, 
appeared in [44] and [71]. A modification of this observer to simplify 
the adaptive dynamics was subsequently reported [62]. Both these 
schemes exhibit the desirable properties that the eigenvalues of the 
observer matrix may be freely chosen (an important capability for 
systems with measurements corrupted by noise), that the simple Lyapunov 
adaptive algorithm is implemented entirely on line during system 
operation, that no derivative networks are required in the adaptive 
algorithm, and that both the state of the system under observation 
and the unknown parameters of that system are progressively determined 
regardless of the magnitude of parameter ignorance. 

In [65] the single-input single-output adaptive observer was 
extended to cyclic multivariable systems by introducing a suitable 
transformation that converts the system to a single-output system. 
Consequently the multivariable adaptive observer in this scheme is of 
the same order as the system regardless of the number of system outputs 
available, and the number of adaptive gains needed to implement the 
observer algorithm equals at least the sum of the system order and the 
number of input parameters being adapted. 

IQ 5 
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In this chapter an adaptive observer for multivariable systems 
is reported for which the dynamic order of the observer is reduced, 
subject to mild restrictions given in Theorem 6.1, to n-p+1 where n 
is the order of the system being observed and p is the number of 
independent output measurements. The observer structure which is 
developed here depends directly upon the multivariable structure of 
the system rather than a transformation to a single-output system. 

The number of adaptive gains is at most the sum of the order of the 
system and the nunber of input parameters being adapted. Moreover, 
for the relatively frequent specific cases for which the nunber of 
required adaptive gains is less than the sum of system order and 
input parameters, the number of these gains is easily determined by 
inspection of the system structure. This adaptive observer possesses 
all the properties ascribed earlier to the single-input single-output 
adaptive observer. Like the other adaptive observers mentioned, some 
restriction is required of the allowable system command input to 
guarantee convergence of the adaptive algorithm, but the restriction 
is more lenient than that required by the full-order multivariable 
observer in [65]. Finally, this reduced observer is not restricted 
to cyclic systems as is [65], 


6.2 Development of The Reduced Observer 

The Problem to be Solved 

An observable and controllable linear time-invarient dynamical 


system described by 

k = Ax + Br x(t 0 ) = x° 

y = Cx 


(VI. 1) 
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is considered, where x(t)c £ n is the state of the system, r(t)s £ 
is the command input and y(t)e 6 ^ is the output. For purposes of 
this chapter, (VI. 1) is multivariable with n>p>l and n>l, the pair 
(C,A) is completely observable, and the pair (A,B) is completely 
controllable. A and B are appropriately - dimensioned matrices having 
parameters of unknown value. C is a known matrix of dimension pxn. 

The problem is to determine the state x of (VI.l) using only the 
input r, the output y, and the structure, but not the values, of 
matrices A and B. This is to be accomplished by a generating process 
which duplicates as little as possible the state information available 
in the output; thus the generating process is said to be a reduced 
adaptive observer. 

The reduced adaptive observer is of the form 
i = F£ + Gy + Dr + Hu 

e(t 0 ) = e° < w - 2 > 

where £ n-p+1 i s the estimate of the missing state information in the 
output of (VI.l). The matrices G and D and the vector u are to be 
adaptively manipulated so as to guarantee that K asymptotically equals 
a transformation of the unknown state variables in (VI.l). F may have 
arbitrary distinct eigenvalues. 

The state x can be ultimately constructed once the transformation 
has been identified. Figure 6.1 illustrates the situation. 

The Strategy of the Solution 

The transformation T, indicated by T 1 in Figure 6.1, allows the 
system (VI.l) to be assumed to be in a form suitable for constructing 
an adaptive law based upon Lyapunov synthesis techniques. 




FIGURE 6 . 1 Adaptive Observer Scheme 
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The strategy for solving the problem posed in the section labeled 
"The Problem to be Solved" is to firht determine the effects of para- 
meter uncertainty in the system upon the accuracy of the observer 
estimate of the system state. In the section labeled "The Error 
Equation" an error vector is defined as a comparison between the 
transformed system state and the observer estimate; subsequently an 
error equation is derived reflecting the influences of parameter un- 
certainty in the system. Theorem 6.1 of the next section defines suffi- 
cient conditions under which (VI. 1) may be transformed into a form 
suitable for a Lyapunov synthesis technique. It is seen in this section 
that with this form the error equation may be considerably simplified. 

In the section labeled "The Adaptive Law" a Lyapunov adaptive synthesis 
technique is used to derive an adaptive law. The essence of this method 
is to define the adaptable parameters in such a way as to insure, by 
means of a Lyapunov function, that the error equation is asymptotically 
stable. Due to the fact that the resulting Lyapunov function chosen 
here (as may be seen by equation (VI. 18) and (VI. 20)) is defined on a 
noncompact manifold. Theorems 6.2 and 6,3 give sufficient restriction 
upon the system input to insure that the error equation is asymptotically 
stable on the compact manifold. Thus an estimate of the system state, 
which asymptotically converges to the true system state, may be obtained 
by inverting the original transformation of the system as indicated in 
the appropriate section. 

As an illustration of the technique of this chapter, an example 
is given and a computer simulation of this example appears subsequently. 

It is propitious to collect here certain definitions which allow 
brevity in the remaining sections of this chapter. The motivations 
for these definitions will be discussed in the appropriate locations. 



no 


Definition 6.1 

hereafter refers to the collection of all non-singular 

J n,p 

square matrices T of dimension nxn having the following properties 
T may be partitioned as 

(p-l)x(p-l) (p-l)x(n-p+l) 


fl» 

T 

11 

1 

1 

• 

1 

V 

T 21 

1 

1 

1 

T 22 


(n-p+l)x(p-l) (n-p+l)x(n-p+l) 


wherein a) = 

b) each element in the uppermost row of T 21 is independent 
of any system parameter. 

and c) the uppermost row of T 22 is CC 0 0 ... 0] with C 4 0. 

When there is no possibility of confusion, wil1 be t^ ferped to 

as k) . 

Definition 6.2 

The "adaptive canonical form" refers to all matrices A of 


dimension nxn having the following properties: 
in partition 


A 11 A 12 


A 21 A 22 


a) A 22 has the form 



Ill 


a x 1 1 1 ... 1 

0 
0 
0 


n-p 


(n-p+l)x(n-p+l) 

where A r is a diagonal matrix with distinct eigenvalues of 
dimension n-p and any real number, 

and b) A 21 has no more than n-1 non-zero elements. 

Definition 6.3 

A square matrix A is said to be cyclic if there exists a vector 
c such that the pair (c,A) is completely observable. Otherwise A is 
said to be non-cyclic. 


The Error Equation 

The development of the error equation is somewhat similar to 
that in [ 7 ] for systems with known parameters. 

Without restriction if C is known, it may be assumed in (VI. 1) 

that C = [I l 0] where I is a pxp identity matrix. For example, 
p . p 

C -i 

the transformation x = [*^*] x transforms (VI. 1) into this form for 
any C, where H is selected to make the transformation matrix non- 
singular. Then in partitioned form (VI.l) is written as 



// 2 - 


y = A ix y + A 12 w + B^r 
w = A 21 y + A 22 w + B 2 r 


i” — n 


- 

y 


y 


x= 


W, 


w 

lj 


- - 


uppermost element 
in w 


(VI. 3) 


where ye § P ^ and we The dimensions of y and w indicate the 

dimensions of the partitions in (VI. 3). Since only w is to be estimated 
by the adaptive observer, the dimension of the vector w is chosen as 
small as possible while still retaining an element of the output , which 


is essential for implementation of the adaptive law. 

The adaptive observer is initially described by 

l = FE. + (FK + G-KM)y - Ky + (D-KB^r + Hu (VI. 4) 

in which £e £, n “P +1 . if a t this point (VI. 4) is taken as a hypothesis 
for a generator of w, it will be shown that the error between w and a 
function of £ can be made to vanish by adaptively adjusting G, D, and 
K. It will be subsequently shown that a suitable transformation of 
(VI. 3) allows (VI. 4) to be rendered unto (VI. 2). 

Let an estimate of w be 5 + Ky. Then defining, as in [7], the 


error 

e = £ + Ky - w (VI. 5) 

on the reduced space ^ it follows that 

• i 

e=£+Ky+Ky-w 

= F($ + Ky - w) + (F - A 22 )w + (G - A 2][ )y 
+ K(y - My) + (D-B 2 - KB^)r + Hu 

Defining M = M-A u so that y - My = y - A n y - My = A^w + - My, 

then e - Te + ( F - A 22 + KA.^)w + (G - A^ - KM)y (VI. 6) 

+ (D - B 2 )r + Hu 
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in which it is seen that the reduced error depends upon both the 
measurable vector y and the unmeasurable (save the first element) 
vector w. It is impossible in a manner similar to the Luenberger 
observer [3,4] to define F = - KA 12 > M = A^, D = G = ^21* 

and H = 0 to eliminate these dependences from (VI,6), since A and B 
are here unknown* 

Rather, it is desired to adaptively adjust the triple (G, D, K) 
so that the coefficients of w» y, and r in (VI. 6) eventually vanish. 

Then if F is chosen with eigenvalues all with negative real parts and 
if u •+ 0, the reduced error e vanishes. 

The Transformation 

If it is possible to show with respect to (VI, 3) that a suitable 
transformation matrix T exists so that T.^ = CT and that A = T AT is 
in adaptive canonical form with the partition element A^ = 

(A 22 - T 21 A i2 ) T 22 having arbitrary specified eigenvalues, then 
setting F = A 22 in the equation (analogous to (VI. 6)) 

e = Fe + (F - A 22 + KA l2 )w + (G - A 21 - KM)y 

+ (D - B 2 )r + Hu (VI. 7) 

permits defining K = 0. Doing this is advantageous since the influence 
of w in (VI. 7) is eliminated, the necessity of adapting K is removed, 
and (since M is related to A^) the influence of unknown elements of 

A n = T xi (A n T u + A i 2 t 2 i ) is diminished - 

As will be seen, under some restrictions on A a transformation T 

can be found that satisfies the preceeding requirement and the additional 
requirement that = CT be independent of parameters of A. By virtue 
of this latter requirement the outputs can be treated as transformed 
state variables without specifically identifying T. 
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For a suitable definition of u, the transformation which satisfies 
these requirements is a member of the collection and the transformed 
matrix A = T _1 AT is in adaptive canonical form. Theorem 6.1 gives 
sufficient conditions on A for the existence of such a T c c/ . 

In the following theorem, let the symbolQ^Cx] denote the range of 
X , let Q = [C 0 0 ... 0], C 4 0 be a row vector of dimension lx(n-p+l) 

and let A 22 denote the (n-p+l)x(n-p+l) partition of the adaptive can- 
onical form 


THEOREM 6. 1 [ CARROLL ] 

Let the pair (A^* ^ ^ 3 ma ^ r ^ x ^ completely observable. 

Then there exists a T e Cf that transforms A into the adaptive canonical 
form in which n-p eigenvalues of ma y almost arbitrarily chosen . 

If in addition 3 Cl then the n-p eigenvalues of 

may be arbitrarily chosen. 

PROOF: The proof is in two parts : to show that a T e J exists that 

puts A ^2 into adaptive canonical form with the desired properties, and 
that A^ also satisfies the requirements of the adaptive canonical form. 

Suppose that (A 22 , A 12 ) of the matrix A is completely observable. 
According to the definition of 3 , the (n-p+1) x (n-p+1) partition T 22 
Of T £ j is arbitrary except for the uppermost row which is 
Q = [C 0 0 ... 0], C 4 0. Since A 22 = T 22 (A 22 - T 21 A l2^ T 22» where 
X is the (n-p+1) x (p-1) partition of T e tf , it must be shown that 
A is of the form required by definition of the adaptive canonical 
form, and that by choosing T^he n -p eigenvalues can be freely chosen. 

It has been shown [62] that there exists a matrix T 22 of the required 
form which transforms a cyclic matrix P into + L, where L is a 
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matrix having only the leftmost column non-zero, if and only if (Q,P) 
is completely observable. In the present context, P = A 22~ T 21 A 12* 111113 

if by choice of T^, P can have n-p eigenvalues equal to the desired 
eigenvalues of A 22 and if (Q,P) is completely observable for this choice 
of ^21 ’ *hen L = 0 (except perhaps for the element in the upper left 
corner, which is irrelevant by definition of the adaptive canonical form). 

Suppose first that (£ [Q T ]C Then for any choice of T 21 

the pair (Q, A 22 - T 21 A 12 ^ com P letel y observable and at least n-p 
eigenvalues of - T 21 A 12 can be ar, hitrarily chosen [67]. Therefore 

A 22 = ^22 ^ A 22 ** ^21^x2^22 * s Captive canonical form with arbitrary 
eigenvalues for some choice of and T 22 of T e J . 

Suppose now that(^ [Q T ]^ CR. [A^]. Since the pair ( A 12 > A 22 ) is 
completely, observable, at least n-p eigenvalues of P = A 22 - t 2 -l A 12 can 
be arbitrarily chosen but (Q,P) may not be observable. A trivial exten- 
sion of theorem 4 of [68] says that the set 44 = ^ T 21 U A 22 ~ T 21 A 12’ ^ 
not observable} is either an empty set or a hypersurface in the parameter 
space of T 21 when the pair ( A 22 > A^) com pl ete ly observable. Con- 
sequently A 22 is in adaptive canonical form with almost arbitrary eigen- 
values for some choice of T 22 and T 21 of T e since the choices of 
is limited to those i 44 . Thus the first part of the theorem 
is proved. 

Now it is shown that A 21 has not more than n-1 non-zero elements 
with the appropriate choice of T e ♦ in the (n-p+1) x (p-l) 
partition T 21 of T e ^ there are (n-p+l)(p-l) - (p-l) = (n-p)(p-l) 
parameter- dependent elements. At most n-p of these elements are needed 
to specify the n-p eigenvalues of A 22 - T 21 A 12 - Therefore, at least 
(n-p)(p-l) - (n-p) = (n-p)(p-2) parameter-dependent elements of T 21 
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ape unspecified. Each unspecified element may be specified so as to 

make an element of A 21 = ( A 21 T 11 + A 22 T 21 ' T 21 T 11 A 11 T 11 " T 21 A 12 T 21 J 

zero. Since there are at most (n-p+l)(p-l) non-zero elements in A 12 , 

eliminating (n-p)(p-2) of them leaves at most (n-p+l)(p-l) - 
(n-p)(p-2) = n-1 non-zero elements in A^. Thus the theorem is proved. 


Remark 

The stipulation that the eigenvalues are "almost" arbitrary when 
0 L<qV ^ ( A 12 } may be illustrated as follows. Let 


22 


11 


*21 


22 


32 


2 3 


a 12 =[001] 


a 32 ? ' 0 * a 21 4 ° 


Then the observability matrix of the pair (Q, A 22 " T 21 A 12^ 1S 


'll 


0 

0 


0 

-t 


11 


'11 


' a 32 t n t ii (t ar a n ) 


From the observability matrix it is seen that the pair (Q, A 22~ T 21 A 12^ 
is completely observable for any choice of T 21 except t^ = 0. 

This implies there exists a hypersurface of dimension unity for which 
the observer eigenvalues may not be located. 
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COROLLARY 

If in addition to the requirements of the theorem the pair 
is completely observable where Q = [C 0 0 . .. 02 * C £ 0 t then the 

uppermost row of the partition ^ may be chosen as zero . 

PROOF: 

The proof of the theorem requires that (Q, A 22 " T 21 A 12) be 

completely observable for some choice of T 2 ^. If (Q» A 22 ) °^ serva ^^ e > 
then (Q, - T 21 A l2 ) is completely observable by the trivial choice 

T 2 ^ = 0. However, since n-r eigenvalues of A 22 - are to be 

arbitrarily chosen by choice of T 2 ^ and at least (n-p)(p-2) elements 
of A 21 are to be chosen zero by choice of T^, it generally requires 
all but p-1 non-zero elements of T^. Generally these elements must be 
parameter-dependent; thus only the p-1 parameter- independent elements 
appearing in the uppermost row of may be zero. 

The Adaptive Law 

It is assumed that (VI. 3) satisfies the conditions of Theorem 
6.1 and consequently may be written as 
y = A n y + A 12 w + B^r 
w = A 21 y + A 22 w + B 2 r 

(VI. 8) 

where A is of adaptive canonical form and the scalar w is a linear 
combination of and elements of y. The scalar w is constructed 
externally to the system in accordance with the upper row of T^ so 
that the transformed system output matrix is in the form assumed in 
(VI. 3). According to the corollary, u = if (Q, A 22 > is completely 
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observable. 


F in (VI. 2) is taken at 


F = I 0 


(VI. 9) 


1_ 0 J (n-p+1) x (n-p+1) 

for X any real number distinct from the distinct eigenvalues of the 
diagonal matrix A^_ p . k e "t h^u^ = + ^1 ^1^ W 1 ” ^1 W 1 (VI. 7) 

may be written 

4 = Fe + <t>y + Vr + Hu (VI. 10) 

e(t 0 ) = e° 

where * = G - A 21 and V = D - The other elements of u will be 

defined later. 

The adaptive law for t and t in (VI. 10) must be defined in terms 
of only those variables which are available for measurement. Consequently 
(VI. 10) will be manipulated in a way to obtain a scalar equation, 
equivalent to (VI. 10), for which such an adaptive law can be formulated. 

Let the (n-p+1) x (p-l) matrix V be defined as 


(pI-A) ^ h^y T 


(VI. 11) 


in which p means » and hj = Cl 1 1 ... U of appropriate 

Clearly the (n-p) x (p-l) submatrix (pI-A n _ p ) - 


dimension* 
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composed of filtered output variables. 

In a similar manner, let the (n-p+1) x m matrix S be defined as 


S s 


(pI-A) -1 h 2 r T 


(VI. 12) 


in which = [1 1 1 ... 1] of appropriate dimension. It will later 

be shown that the adaptive law requires at most n-1 elements of V, 

Consider now the lowermost n-p scalar equations of (VI. 10). The 

i^ equation , 2 i <_ n-p+1, is 

p-1 m 

= “ x i e i + l +n y-5 + l *n + h.u. (VI. 13) 

1 j=l 13 3 j=l 13 3 11 

If in (VI. 13) h^u^, 2 i <_ n-p+1, is defined as 

Vi = Vi 


h i u i *ij v ij f ^ s ij (VI. 14) 

2 i ^ n-p+1 

then (VI. 13) is a separable differential equation for each i. To show 
this, the identities for each i 


. v. . 
13 13 


13 13 


T 

3=1 

£ . . v. . 
13 13 

II 

9?|°* 

p;i 

C I 

3=1 

♦ij v 

-V 

3=1 

m 

I 

3=1 

• 

(/>. . s . . 
13 13 

- 

dt 

m 

C l 

j=l 

♦ii s ij ] - 

m 

l 

3=1 


are needed. Using them, (VI. 13) becomes 
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e i = 


V 


p -1 m 

,.e. + V <}>. . y . + l . r. 
i i v J-3 J 3 13 j 


m 


/ . v. . - y ip. . s. . - 

jai l 3 X 3 j = l 1] ^ 


p-1 m 

4> . , v. . + 

3=1 ]=1 

Substituting (VI. 11) and (VI. 12) into the above yields 


~ [ y d>.. v.. + y ij;.. s..] 

dt u _.S 13 >, 13 13 


^ p-1 m p-1 m 

At Ce. - l <t>.. v. - l 8.,] * -X. [e. - ^ (J).. v., - l <{».. s..D 

dt 1 1] 13 13 13 11 jS-j^ 13 13 j = 1 13 13 


(VI. 15) is integrated to yield 
p -1 m 

i. = y <f>.. v.. + y Ip., s.. + 6 . exp[-X.t] 
1 Y n 11 , L . 13 13 1^1 


where 


3=1 1] 3=1 


P-1 


(VI. 15) 


(VI. 16) 


m 


0 , = e? ~ l * H (t) v (t) " I ^(t) s (t) 
± X j=l ' L J 


at t = t^. 

Equation (VI. 16) is applied to the first equation of (VI. 10) 
giving 

. IY 1 m n-D +1 

e. = -Le, + tr * V + tr fS + <Ky + > 6 . exp [-X.t] (VI. 17) 

1 11 l'p ^"2 x 1 


It is thus seen that (VI. 10) and (VI. 17) are equivalent, with 
definition of u in (VI. 14), but with the difference that (VI. 17) 
is a scalar equation. The adaptive law, dependent upon measurable 
vari allies only, may now be formulated, 

A Lyapunov function candidate is selected as 

V ~ e l + 6 1 *1 + tr (A ® + tr < r ® * T *) (VI. 18) 

in which A and r are matrices having no non-positive element and the 
symbol© represents element-by-e3.ement multiplication of matrices. 
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The time derivative of (VI. 18) along the trajectory described by 
VI. 17) is 


2 (/ = . ye 


PT'I 


+ tr $ T (A© i + Ve JL ) + tr V T (r © V + Se.^ 


n-p+1 

+ l 6. exp [-A.t]e. 
i=2 1 1 J 

Then ( VI . 19 ) can be made 

« „ n-p+1 


21 / = - Xfl + 


i=2 


0^ exp[-X^t]e^ 


whenever ^ , $, and 'F are defined as 

ix - -Vx 


A ® * = - Ve 
r © y = - se. 


(VI. 19) 


(VI. 20) 


(VI. 21) 


Equations (VI. 21) may be also written in scalar form as 
1 


*1 ~ 6' 


1 


Vl = ’ g l 


d>. . = - T7— v. . e. =-g. . 
i] 1 


(VI. 21a) 


ii». . - 
i] 


s . . 6 ^ — — d . . 

,2 *3 1 ^ 

il 


for each i, j in their proper domains. Equations (VI. 21) or (VI. 21a) 
are the adaptive laws sought. 

V is eventually negative definite whenever all the eigenvalues 


~ A.^ » ~ ^2 * 


.... -A _ have negative real parts since then the initial 
* n-p+1 


condition disturbances 6^ decay exponentially. Consequently e^ is 
asymptotically stable in the sense of Lyapunov. 
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It is desired that lim e(t) = 0 in order for the adaptive observer 
to generate the system state. If some restriction on the input vector 
r is imposed, it can be shown that e^ •+ 0 implies e *♦" 0. 

To see this, consider the limiting value of (VI. 17) which is 

o = tr ^ V + tr t^y^ (VI. 22) 

If by suitably restricting r, or equivalently V, S, and y , so that 

T T 

(VI. 22) implies in the limit that 4> = 0 , V =0, and ^ = 0 , then 

(VI. 10) is 

e" = Fe 

implying e ■* 0 since F is an asymptotically stable matrix. The above 
equation follows from (VI. 10) since u^, 2 <_ i <_n-p+l, is zero in the 
limit as evident from (VI. 14) and (VI. 21). 

The following theorems define the restriction on r guaranteeing 
$ - o,f =0, and = 0 for e^ = 0 when the steady state r is periodic* 


THEOREM 6.2 [ CARROLL ] 

Let q be the number of adaptive parameters in the observer 
(VI. 2) y let the observer matrix F have eigenvalues all with negative 
real partSy and let the system (VI. 3) be completely controllable 
through each column vector in the input matrix B. If the collection 
of inputs {r^y r^ ..., r possesses no fewer than [( q )/2] distinct 
steady-state frequencies then (VI. 2) generates the system state. 

PROOF: 

The proof is by induction. It is shown [71,62] that the theorem 
holds for m=l. Assuming that the theorem holds for m-ir^, it will be 


shown that it holds for m=nyH. 

Let each y., 1 < j < p,be related to the inputs r^, r^ , 
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by 


m i +i 

y i = k K V P> ^ 


where p = d/dt. 


Then (VI. 22) is 

V 1 


k=l 


p - 1 n -e +1 p - 1 h j k (p) 

L ' * l 


°= l ‘ + l +u h -iV ( P> + 


+4V 

+ — ) 


j=l 


ij i‘j jii "H P^i V*\ 


* *1 V p)1 r k 

Since , by (VI. 20), e. ■+ 0 and, by (VI. 21), A.., \p.., and $ are 

1 lj lj X 

constants, (VI. 23) may be written 

V P>r l + H 2 (p>r 2 * ••• + H m 1 (p) \ - - H V l (p,r V l 


(VI. 23) 


( VI . 24) 


where H^(p) are the terms in brackets in (VI. 23) for each k, 1 <^k <_ m^+l. 
Let the number of distinct adaptive coefficients in the left side of 
(VI. 24) be and the number of distinct adaptive coefficients in L+ 1 (P ‘ 
be q 2 . By definition q=q 1 + By assumption (r^ r^ , ..., r m } 

contains [( )/2] distinct frequencies and the left side of (VI. 24) 

is zero since H^(p) = H^fp) = ... = (p) = 0 and 

0 = H (p)r 

m^+1 m^+1 

Therefore only the distinct coefficients of H (p) are 

V 

non-zero. By inspection of (VI. 23), these are the terms which are 

q 2 in number. Thus by [71,62] if r m + 1 contains at least [( q 2 )/2] 

distinct frequencies (i.e. distinct from the frequencies of 
{r lS r 2 , ..., r^ }) then +1 (p) = 0* Consequently (r^, r 2 , ...» r^ +1 > 
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containing [( q )/2] distinct frequencies implies that H^p) = H 2 <p) = 

... = h (p) = 0 which was to be proved. 

V 1 

THEOREM 6. 3 [ CARROLL ] 

Let the conditions on the observer (VI. 2) be as stated in Theorem 
6.2, but let there be no requirement upon the column vector of the 
input matrix B of the system (VI. 3). Then it is sufficient that each 
input e r each possess K q )/2l distinct steady-state frequencies 
in order for (VI. 2) to generate the system state. 

PROOF: 

The proof follows from equation (VI. 23). 

When any h.,(p) is zero or linearily dependent, then the parameters 
3 * 

A . and <i>.. are not fully "coupled" with each of the inputs of 
i] l] 

equation (VI. 23). This in general requires that frequencies must be 
assigned to each r fc depending upon the degree of freedom in the 
coefficient of r. in section (VI. 23). Assuming complete "decoupling" 

K 

of each $ and i|> with respect to each v k , it is clearly sufficient that 
each v. must possess [( q )/2] frequencies from equation (VI. 24). 

K 

Remark : 

The sufficient conditions stated in Theorem 6.3 are noted to be 
very conservative as a cursory glance at the proof of this theorem 
reveals. It is suspected by the author that under the conditions of 
Theorem 6.3 the requirement for state generation may be liberalized to 
allow only the collection of inputs { r v r ? , ...» r^) possess [( q )/2] 
steady-state frequencies, as in Theorem 6.2, but with the additional 
restriction that the frequencies must be assigned in some way depending 
upon the controllability structure of system (VI. 3). 
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At the time of this writing, however, the above speculation has not 
been proved. 

Reconstruction of the System State 
The observer (VI. 2) generates the state of the transformed system 
(VI. 8). To obtain the state of the system (VI. 1) the observer estimate 
£ must be transformed by 

x = t y 

A 

where x is the estimate of the system state x. T cannot be immediately 
written since it contains unknown elements of A; however, sufficient 
identification of the system matrix A occurs as a result of the adaptive 
laws (VI. 21) to allow T to be determined. Consequently, the time- 

A 

varying matrix T(G,D) may be constructed so that 

x = T(G,D) 

is the observer estimate of x. Since lim T(G,D) = T, the state x is 

t-*» 

obtained. 

Theorem 6.4 summarizes the results of this Chapter 
THEOREM 6. 4 

The state of system (VI, 1) may he adaptively constructed by the 
observer (VI. 2) by employing the adaptive algorithm (VI. 21) and the 
control vector u of (VI. 14 ) , both subject to definitions (VI. 11) and 
(VI. 12) if 

a) in (VI. 1) the partition ^ 22 ^ ^ 8 oon V^ e ^ e ^y 

observable, and 
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b) the number of distinct frequencies in the system 
command input r is no fewer than Z( Q )/2 ] where 
q is the number of parameters to be adapted. More- 
over y the number of parameters to be adopted is not greater 
than n plus the number of input parameters. 


Example 

A specific example is given here to illustrate the design of a 

reduced-order adaptive observer. 

Suppose the system is represented by 



with a , a , a , a , b , and b unknown constants. (This is, of course, 
0 12 3 1 2 

not the most general input matrix.) 

It is seen that (A^, A^) = ( ^ j] , JJ > is completely 
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observable. Therefore there exists a non-singular square transformation 
T e d that puts (VI. 1*) into adaptive canonical form. Such a matrix is 



Note that the uppermost row of T^ is zero since ([1 0], a 22 > 

is a completely observable pair. 

Then 



where x = a^g - a 2 X^ - a Q 

From the form of (VI. 3*) it is seen that 

^21 ~ ®21 " ^ 

, 3 . 

♦22 ” ^22 + ^ a l X 2^ 

*21 = d 21 " b l X 2 

^22 _ d 22 “ b 2 


(VI. 10*) 
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is to be adapted. Note that only 4 parameters need to be adapted for 
which in (VI.l*) there are 6 unknowns. 

The adaptive laws are 

hi*' "^7 V 21 e l 


V 22 e l 


e, 

y 21 21 1 


v s 22 S 1 
'22 


in which e = £ - y , and the reduced observer is 

X X o 


1 u 


o -x 2 c 2 


- X 2 *1 


^2 2 3^2 


d 21 d 22 r 2 


+ (A 1 + X 2 )y 3 


Sl V 21 + ^22 V 22 + Sl S 21 + S 2 S 22 

.12 12^1 2^1 2 N 
" ( fi 21 V 21 + 6 22 V 22 + y 21 S 21 y 22 S 22 )e i 


Si + X 2 V 21 = y l 


v 22 + V22 = y 2 
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(VI. 12*) 


The observer eigenvalues, -X^ and -X 2 , are arbitrary but distinct 
negative numbers. 

The state x of system (VI. 1*) may be constructed by the equation 



Computer Simulation 

The system of section "Example 1 ' was simulated on a digital 
computer. The system parameters assumed unknown were b 2> a^, a^, 
and a Q . The following values were chosen for simulation: 


a o = 15 

b l= 1 

Y 21 = 1/10 

a^ = 33. 5 

b 2 = 2 

« 22 = 1/250 

a 2 = 26.0 

x x = 10 

4> 21 <0) = 180.25 

a 3 = 8.5 

A 2 = 5 

^ 22 (0) = -100 

The inputs r^ and r 2 were 

chosen as sine 

waves with frequencies 


3.5 and 5 rad/sec. respectively. The behavior of the two adaptive 
parameters <f> 21 and \p 22 are shown in Figure 6.2 and the (transformed) 
observer error e 2 is shown in Figure 6.3. 




Figure 6,2 PARAMETER FUNCTIONS VS. TIE 
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t 

sec. 


ERROR e 2 VS. TIME 
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CHAPTER VII 


UNRESOLVED QUESTIONS 

Due to the newness of the adaptive observer concept and the apparent 
richness of this concept, there remains much to be done with the adaptive 
observer. With reference to Chapters IV- VI , the thrust of investigation 
has been to attain greater simplicity in design (Chapters V and VI) 
and to allow greater freedom in eigenvalue selection of the adaptive 
network (Section 5.2). Certainly even better results may be attained in 
this endeavor; however there are a nunber of different questions that 
should be resolved. This chapter discusses some of them and, in the 
section entitled "Design Considerations", the complexity of choosing gain 
parameters is illustrated by simulation examples. 

7.1 A Separation 'theorem 

Throughout the literature concerning the adaptive observer, the 
technique has been to require the eventual generation of state of an 
unknown linear system given the input and output measurements of the 
system and its structure. This is essentially an open-loop process. 

Since in the full order observer the unknown parameters are identified 
as a by-product of adaptation, the adaptive observer may be placed in a 
closed loop in order to control the system. In this case both the state 
of the system and the observer estimate of the parameters of the system 
ore used in the feedback control law. Notwithstanding the certainty 
that the adaptive observer eventually becomes a form of the Luenberger 
observer and therefore comes to possess the closed loop properties of the 
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Luenberger observer (see section 2.4), it has not been shown that such a 
feedback system is stable throughout the adaptive process. 

The difficulty in showing this lies in the fact that, before adapta- 
tion is essentially complete, the observer is both time-varying and non- 
linear; consequently a simple pole location analysis in order to determine 
over-all system stability cannot be made as was done with the Luenberger 
observer. Rather, investigations into this subject must employ a more 
sophisticated stability analysis. 

7.2 A Functional Adaptive Observer 

Should the observer be used in a closed loop to generate a control of 
the form r = a T x, it was seen in Section 2.5 that a Luenberger functional 
observer could be constructed of order v-1 to generate r rather than the 
complete state vector x. Since v may be much smaller than n-p , this re 
presents a great savings in complexity* 

An adaptive functional observer might therefore considerably reduce 
not only the order of the observer but also the complexity of the associated 
adaptive law. It is the complexity of the adaptive law - in terms of the 
number of integrators and number of multipliers needed to construct the 
law - that is a serious factor in applications. 

However, the theory of the functional observer must account not 
only for the generation of a linear function a x, as the Luenberger 
linear function observer does but also for the ickntifiability of the 
parameters associated with a T . The reason for this is that, in general, 
the vector a T is dependent upon the unknown parameters of the system when 
r = a T x is used for many controls. Consequently the functional adaptive 
observer must he defined on the adjoined space of the system state and 

No attempt, to the author’s knowledge, has 


the system parameter space , 
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been made to develop a functional adaptive observer. 

7. 3 Canonical Forms 

As previously remarked in Section 5.1, the more general canonical 
form offered in [63] offers exciting investigation in the adaptive 
laws resulting from the many choices of canonical forms. 

In addition to the various improve ment d , if any, in the quality 
of different adaptive laws synthesized, it is hoped that a general 
theory will be developed whereby one may determine a priori at least 
some of the qualities of adaptive laws in relation to the canonical form 
chosen. 

7. 4 The Effects of Noise 

This dissertation has emphasized the importance of the observer, 
whether of the Luenberger kind or the adaptive kind, to generate the 
state of a linear system in the presence of noise. However, there has 
been no reported work with the adaptive observer in terms of its ability 
to do this. Investigations are needed to determine the degree of 
susceptibility of the adaptive law to noise, to determine the relative 
merit of the different canonical forms proposed in regard to this degree 
of susceptability to noise, and the effects of observer, and filter, pole 
placement in minimizing that susceptability . By susceptability, one means 
the bound on the region for which the error between observer estimate 
of state and the state of the unknown system cannot be guaranteed to 
diminish, and the effect of noise upon convergence rate outside this 
bound. (That, in fact, a bound exists has been demonstrated in relation 
to the model-reference Liapunov adaptive problem). 
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7.S Modeling 

One may wonder what happens to the adaptive observer when an output 
of a non-linear system is substituted for that of a linear one, or if an 
output of a system of higher order than the (full order) adaptive 
observer is substituted. That this is an important question is indicated 
by the observation that few, if any, real systems are linear, and that 
many real systems are of unknown order. 

It has been maintained by some that the resulting configuration of 
the adaptive observer in each instance discussed above will be the 
"best 1 * linear model of the process being observed. It is unknown to 
the author whether in fact this occurs. The difficulty in determining 
this is the vagueness of the term "best linear model". Nevertheless, 
modeling is an important factor which should be the subject of an interest- 
ing investigation. 

?. 6 Design Consideration - Speed of Response 

As has been previously noted, one of the salient features of the 
Liapunov synthesis technique is that the resulting adaptive algorithm 
is guaranteed to converge regardless of the magnitude of parameter 
ignorance. In addition, this algorithm is guaranteed to converge 
regardless of the choice in magnitude of the positive adaptive 
gain constants 3 appearing in Section 4.2 as m s /nu and in Section 
6.2 as T and A. 

However, as the third chapter makes evident, this choice of the 
adaptive gain constants affects the rate of convergence of the parameter 
estimates and the error between state estimate and system state. In 
the context of the adaptive observer, the accelerated adaptive laws 
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due to Phi Hip son and Monopoli (See chapter III) cannot be implemented 

because of the requirement that lim u(t) e 0. Consequently the choice 

t-**> 

of the adaptive gain constants T , A, or m s /nu play a significant role 
in determining the rate of convergence of the observer estimates to 
their proper values. 

However, the criteria for determining a "good" choice of gain 
constants is not defined. It is difficult to do so because of the non- 
linear nature of the formulation of the adaptive observer, and the 
consequent interaction between the various other constants to be 
chosen in the observer. 

Other constants which may affect the rate of convergence are the 
observer eigenvalues, the filter poles, the magnitude and frequency 
of the system input, the initial conditions upon the parameter ignorance, 
and the amount of noise inherent in the measurements. 

To gain some understanding of the relationship among these various 
factors and the rate of convergence, the example of Chapter VI has been 
investigated in the absence of noise by computer simulation. The 
remainder of this chapter reports some of these results. It is not 
intended that these results establish a relationship for all adaptive 
observer structures or even to establish "rule of thumb" design 
techniques ; rather these results are given to indicate the complexity 
of the problem and to provide a starting point for future investigations 
into the relationship between rate of convergence and parameter gains. 

In Figure 7.1, the parameter estimate 2 f° r t ^ ie parameter 

a l ” ^2 example in Chapter VI is plotted against time and as a 

function of the gain constant 6^1 w ^ en $21 * 8 ^ e Parameter being 

adapted (the other being preset to their proper values). The observer 
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eigenvalues were -4 and -5 and the input was a square wave of 
frequency 3.5 and 5 rad/sec and magnitude 50. It is noted that for 1/^21= 
100 the curve decays almost exponentially, but for larger gains 
there is some oscillation. The convergence time for all choices of 
gains is about 3 seconds. 

In Figure 7.2, only the input parameter is adapted. The 
data for eigenvalues and input is as before. It is noted that even 
for low gains the behavior is oscillatory, yet faster in convergence 
than the plant parameter. This behavior characterizes the input 
parameter behavior. One additional point: for high gains of lA^o 

the convergence time increases. This implies an existence of an 
"optimal" gain. 

The major observation drawn from Figures 7-1 and 7-2 in that, 
with but one parameter being adapted in the example of Chapter VI, the 
reduced order observer, the convergence rate is very acceptable for 
a wide range of adaptive gains. 

When two parameters are adapted simultanteously the situation 
is more complicated. This stems from the fact that interaction between 
the two parameters affects the rate of convergence. In Figure 7-3 


both $ 2 ^ and ij l> are simultaneously adaptive; the curves shown here 

are the effect on the plant parameter as the plant gain constant 
is changed but the input gain constant , for t 22 > is constant 


at l/y^ = 10* The input is a sine wave of frequency 3.5 and 5.0 
rad/sec. and the observer eigenvalues are -5 and -10. Figure 6-2 


may also be compared with these. In this case, there is a radical change 


in the behavior of as a function of the corresponding gain. The 
better gain seems to be for l/y^ = ^00. The fact that the curve for 





138 


1/6 = 1000 is slower to converge indicates the existence here of 

an "optimal" gain. 

To explicitly see the effects of the interaction between gains, 
Figure 7.4 is offered. This is the plot of corresponding to 
Figure 7.3. It is emphasized that in Figure 7.4 the input gain con- 
stant 1 /y 22 the same for each of the curves * the difference in the 
curves illustrated here is due entirely to interaction with the change 
in plant gain l/ 1 ^^* It is seen that the effects of interaction are 
marked. 

The insight to be gained from Figures 7,3 and 7.4 seems to be 
that convergence time is much longer for two adaptive parameters , that 
there is marked interaction between the two parameters , and that an 
optimal choice of gain exists in order to minimize convergence time. 

In Figure 7.5, the plant parameter <t> 21 is shown when the plant 
adaptive gain 1/<$ 21 = 50 but the input adaptive gain 1 /y 22 changes. 

The input is as in Figures 7.3 and 7.4, but it is warned that the two 
curves shown in Figure 7.5 are not exactly compatible since the 
initial condition on was also increased when 1/Y 22 = 50. Never- 
theless, the figure tends to indicate that a faster convergence rate 
is obtained if the ratio V 22 /«2i is high. 

The effects of changes in the quality of system input frequency 

is shown in Figures 7.6, 7.7, and 7.8. In Figure 7.6, the plant 

parameter <J> 21 is shown for an input adaptive gain 1 /y 2 2 10 

plant adaptive gain 1/6 21 = 50 when the system input is either a sine 

wave or a square wave of frequency 3.5 and 5 rad/sec. and magnitude of 

50. The plant eigenvalues were -5 and -10. It is seen that the square 

wave input forces cj^ to converge faster than the sine wave input for 

these choices of plant and input gains. The same effect is seen in 
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1 ^ 22 » not here. 

Contrarily, for gains in which 1/6^ = 1000 and I/Y 22 = 

Figure 7.7 shows that the sine wave input converges faster than the square 
wave input. The curve for the square wave input is much more oscilla- 
tory than the sine wave input; no such effect is seen in Figure 7.6. 

The same effect is seen in Figure 7.8 for the input parameter : 
for gains = 1000 and I/Y 22 = the s ^ ne wave input forces 

^22 conv,er 6 e faster without as much oscillation as the square 
wave input, unlike the case for which l/^i = ^0 ^^22 = 

As a result of Figures 7.6, 7.7, and 7.8, it may be concluded that 
the convergence rate is frequency dependent and that the choice of 
"good" adaptive gains depends not only upon the interaction between 
all the gains but also upon the frequency of the input signal . 

Other investigations not illustrated here tend to show that 
the convergence rate is very dependent upon the choice of observer 
eigenvalues X^. 

These studies serve to emphasize both the need and the difficulty 
of finding a rule whereby a choice of adaptive gains may be chosen 
in order to yield an acceptable convergence time. Lacking such a 
rule, it is a very difficult task, when there are many adaptive gains 
to be chosen, to choose the gains because of the interaction between 
all the gain constants, between the gain constants and the input 
frequency, and between the gain constan ' ts and the observer eigenvalues. 

The effects of initial conditions (dependent upon parameter 
ignorance) of the adaptive integration have not been investigated. 
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Figure 7.8 

Dependence of rate of convergence of i J» ■ upon input frequency 
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